-- Logs begin at Thu 2022-05-26 11:42:28 UTC, end at Thu 2022-05-26 13:47:28 UTC. -- May 26 12:37:43.816081 dv-cinder-815146-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 12:37:43.825906 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:37:43 2022] *** May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: nodename: dv-cinder-815146-11-iscsi May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: machine: x86_64 May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: clock source: unix May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: pcre jit disabled May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: detected number of CPU cores: 4 May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: current working directory: / May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: detected binary path: /usr/bin/uwsgi-core May 26 12:37:43.826772 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: your processes number limit is 47680 May 26 12:37:43.827677 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: your memory page size is 4096 bytes May 26 12:37:43.827677 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: detected max file descriptor number: 2048 May 26 12:37:43.827677 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: lock engine: pthread robust mutexes May 26 12:37:43.827677 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: thunder lock: enabled May 26 12:37:43.827677 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 12:37:43.827677 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:37:43.873638 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: Python main interpreter initialized at 0x55845116b9c0 May 26 12:37:43.873638 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: python threads support enabled May 26 12:37:43.873638 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: your server socket listen backlog is limited to 100 connections May 26 12:37:43.873638 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: your mercy for graceful operations on workers is 90 seconds May 26 12:37:43.874012 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:37:43.874089 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: *** Operational MODE: preforking *** May 26 12:37:43.874317 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: *** uWSGI is running in multiple interpreter mode *** May 26 12:37:43.874317 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: spawned uWSGI master process (pid: 110324) May 26 12:37:43.874570 dv-cinder-815146-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 12:37:43.875354 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: spawned uWSGI worker 1 (pid: 110325, cores: 1) May 26 12:37:43.875518 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: spawned uWSGI worker 2 (pid: 110326, cores: 1) May 26 12:37:43.875645 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:37:45.079941 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:37:45.175522 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:37:45.828612 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:37:45.828612 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: from cryptography.utils import int_from_bytes May 26 12:37:45.829210 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:37:45.829210 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: from cryptography.utils import int_from_bytes May 26 12:37:45.897278 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:37:45.897278 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: from cryptography.utils import int_from_bytes May 26 12:37:45.897630 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:37:45.897630 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: from cryptography.utils import int_from_bytes May 26 12:37:48.558998 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:37:48.559655 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:37:48.559655 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:37:48.560015 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:37:48.560265 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:37:48.560531 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:37:48.560897 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.560981 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:37:48.561060 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.561286 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.561387 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:37:48.561619 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.561730 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:37:48.561890 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:37:48.562001 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.562236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.562350 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.562581 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.562697 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.562901 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.563012 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.563217 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.563356 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.563474 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.563611 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.563780 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.563880 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.564099 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-11-iscsi {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.564293 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.564415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.564502 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.564718 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.564820 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.565035 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.565141 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.565304 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.565390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.565625 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-11-iscsi {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.565773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.566068 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.566171 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.566257 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.566348 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.566544 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.566756 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.566868 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.567167 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.567289 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.567484 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.567605 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.567785 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.567897 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.568271 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.568713 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.568888 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.569131 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.569219 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.569453 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.569583 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.569761 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.569858 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.570084 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.570174 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.570391 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.570477 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.570773 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.570869 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-11-iscsi {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.571094 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.571180 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.571409 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.571507 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.571734 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.571819 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.572043 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.572180 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.572439 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-11-iscsi {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.572531 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.572754 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.572838 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.573066 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.573163 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.573379 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.573474 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.573678 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.573771 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.574001 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.574086 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.574316 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.574412 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.574655 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.574746 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.574992 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.575078 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.575289 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.575373 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.575592 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.575691 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.575898 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.575983 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.576210 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.576304 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.576510 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.576602 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.576810 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.576895 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.577080 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.577189 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.577386 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.577482 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.577705 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.577797 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.578006 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.578101 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.578309 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.578403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.578575 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.578677 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.578825 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.578910 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.579142 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.579236 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.579455 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.579548 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.579757 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.579843 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.580031 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.580125 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.580297 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.580400 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.580591 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.580684 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.580912 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.580999 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.581215 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.581310 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.581521 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.581615 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.581826 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.581916 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.582127 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.582220 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.582428 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.582514 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.582754 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.582841 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.583056 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.583153 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.583374 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.583501 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.584249 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.584351 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.584665 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.584751 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.585201 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.585293 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.585471 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.585793 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.591489 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.591646 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.591774 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.591872 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.591872 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592016 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592104 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592183 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592258 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592335 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592418 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592497 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592586 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592672 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592757 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592833 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.592911 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593002 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593116 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593207 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593287 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593402 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593487 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593617 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593721 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593804 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593889 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.593964 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594049 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594136 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594215 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594291 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594374 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594441 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594539 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594633 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594713 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594797 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594876 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.594949 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595088 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595170 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595247 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595313 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595436 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595517 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595652 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595743 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595875 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.595999 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.596080 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.596146 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.596350 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.596441 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.596565 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.596670 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.596754 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.596827 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.597080 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.597228 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.597345 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.597509 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.597738 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.598001 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.598126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.598220 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.598353 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.598604 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.598706 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.598861 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.599058 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.599176 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.599450 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.600041 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.600173 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.600173 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.600524 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.600685 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.600841 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.600971 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601103 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601189 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601189 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601442 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601582 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601582 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601777 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601935 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601935 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.601935 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.602310 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.602453 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.602453 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.602744 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.602857 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.602857 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.603131 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.603221 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.603376 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.603512 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.603512 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.603730 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.603889 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.603889 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.604131 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.604252 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.604374 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.604467 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.604467 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.604660 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.604807 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.604807 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.605029 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.605136 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.605291 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.605432 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.605728 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.605848 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.606063 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.606210 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.606508 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.606663 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.606857 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.607114 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.607272 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.607450 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.607581 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.607760 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.608005 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.608137 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.608353 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.608501 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.608664 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.608884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.608988 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.609286 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.609416 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.609614 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.609822 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.610015 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.610223 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.610379 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.610585 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.610879 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.611021 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.611227 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.611530 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.611688 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.611916 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.612089 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.612276 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.612636 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:37:48.612808 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.612998 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.613250 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.613397 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.613810 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.613992 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.614147 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.614440 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.614622 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.614917 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.615104 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.615318 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.615642 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.615865 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.616080 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.616228 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.616387 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.616640 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.616791 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.616986 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.617292 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.617387 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.617603 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.617909 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.618056 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.618268 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.618506 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.618679 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.618968 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.619188 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.619296 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.619649 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.619753 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.619960 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.620268 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.620347 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.620726 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.620805 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.621032 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.621333 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.621411 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.621631 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.621909 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.622123 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.622423 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.622508 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.622789 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.623123 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.623329 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.623423 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.623739 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.623844 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.624040 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.624282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.624407 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.624636 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.624790 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.624939 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.625284 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.625378 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.625593 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.625773 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.625966 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.626296 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.626389 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.626682 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.626785 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.627034 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.627267 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.627378 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.627718 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.627851 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.628021 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.628237 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.628336 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.628668 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.628765 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.629028 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.629121 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.629377 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.629526 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.629728 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.629968 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.630055 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.630343 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.630442 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.630696 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.631028 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.631366 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.631467 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.631689 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.631919 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.632008 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.632318 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.632413 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.632642 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.632789 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.632957 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.633266 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.633362 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.633572 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.633781 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.633870 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.634164 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.634251 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.634466 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.634694 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.634787 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.635109 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.635205 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.635542 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.635750 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.636033 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.636130 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.636370 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.636580 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.636668 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.636980 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.637074 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.637310 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.637436 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.637612 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.637914 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.638047 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.638234 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.638435 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.638641 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.638913 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.639014 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.639332 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.639421 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.639683 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.639813 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.640152 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.640240 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.640571 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.640657 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.641010 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.641111 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.641386 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.641483 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.641773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.641862 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.642174 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.642296 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.642566 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.642791 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.642922 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.643227 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.643330 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.643907 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.644002 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.644323 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.644413 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.644910 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.645030 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.645102 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.645176 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.645403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.645582 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.645780 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.646014 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.646143 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.647074 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.647415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.647585 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.647818 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.648054 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.648229 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.648508 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.648605 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.648853 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.648950 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.649168 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.649386 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.649497 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.649806 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.649894 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.650151 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.650239 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.650487 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.650705 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.650845 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.651154 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.651241 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.651491 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.651579 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.651799 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.652030 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.652127 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.652450 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.652537 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.652766 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.652905 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.653110 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.653350 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.653466 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.653802 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.653889 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.654250 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.654338 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.654705 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.654797 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.655019 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.655185 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.655362 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.655645 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.655735 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.655966 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.656098 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.656318 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.656585 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.656681 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.656995 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.657135 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.657324 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.657557 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.657653 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.657930 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.658018 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.658234 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.658455 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.658585 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.658856 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.658953 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.659185 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.659315 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.659532 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.659763 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.659942 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.660218 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.660337 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.660620 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.660717 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.660984 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.661081 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.661347 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.661473 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.661741 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.662750 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.662851 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.663066 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.663477 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.663569 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.663825 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.663951 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.664167 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.664405 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.664494 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.664847 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.664933 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.665228 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.665332 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.665562 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.665761 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.665850 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.666162 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.666258 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.666502 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.666741 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.666834 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.667130 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.667297 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.667436 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.667742 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.667831 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.668062 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.668215 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.668371 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.668677 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.668772 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.668982 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.669146 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.669329 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.669604 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.669693 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.670030 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.670119 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.670411 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.670511 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.670820 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.670920 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.671127 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.671360 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.671447 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.671723 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.671810 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.672028 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.672247 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.672361 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.672690 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.672936 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.673140 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.673265 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.673574 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.673671 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.673898 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.674033 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.674234 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.674571 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.674664 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.674918 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.675043 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.675263 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.675507 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.675639 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.675947 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.676044 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.676256 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.676399 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.676574 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.676873 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.676962 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.677265 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.677420 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.677699 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.678131 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.678354 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.678509 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.678767 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.678858 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.679070 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.679301 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.679406 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.679657 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.679744 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.679979 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.680195 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.680312 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.680658 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.680786 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.680989 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.681135 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.681314 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.681607 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.681717 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.681933 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.682033 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.682232 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.682501 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.682677 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.682920 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.683105 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.683260 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.683541 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.683668 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.683927 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.684032 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.684256 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.684514 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.684630 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.684950 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.685060 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.685288 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.685382 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.685647 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.685823 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.685948 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.686264 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.686361 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.686601 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.686765 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.686935 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.687223 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.687367 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.687531 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.687724 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.687834 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.688143 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.688266 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.688449 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.688675 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.688778 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.689052 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.689152 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.689377 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.689495 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.689676 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.689962 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.690057 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.690278 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.690418 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.690595 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.690898 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.691004 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.691200 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.691377 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.691500 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.691775 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.691869 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.692113 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.692219 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.692431 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.692655 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.692789 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.693674 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.693827 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.693975 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.694249 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.694476 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.694705 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.694893 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.695165 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.695336 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.695469 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.695786 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.695902 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.696110 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.696245 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.696450 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.696711 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.696803 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.697129 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.697251 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.697564 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.697662 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.697873 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.698105 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.698226 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.698483 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.698643 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.698848 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.699053 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.699143 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.699436 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.699523 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.699736 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.699915 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.700037 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.700335 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.700422 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.700636 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.700833 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.700923 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.701239 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.701325 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.701536 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.701695 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.701836 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.702133 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.702219 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.702472 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.702579 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.702821 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.703074 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.703172 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.703473 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.703561 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.703815 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.703902 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.704200 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.704290 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.704528 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.704794 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.704884 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.705171 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.705259 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.705479 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.705682 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.705850 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.706145 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.706246 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.706472 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.706599 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.706928 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.707028 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.707356 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.707455 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.707671 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.707910 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.708001 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.708274 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.708368 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.708574 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.709037 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.709341 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.709431 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.709650 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.709956 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.710142 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.710274 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.710636 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.710740 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.710983 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.711085 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.711310 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.711537 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.711624 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.711966 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.712054 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.712357 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.712446 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.712724 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.712848 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.713031 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.713336 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.713433 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.713719 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.713806 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.714071 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.714214 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.714418 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.714727 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.714831 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.715113 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.715214 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.715538 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.715633 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.715940 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.716041 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.716309 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.716397 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.716643 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.716786 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.716951 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.717223 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.717311 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.717568 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.717662 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.717869 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.718145 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.718243 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.718492 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.718601 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.718948 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.719093 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.719257 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.719454 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.719564 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.719864 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.719950 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.720189 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.720328 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.720495 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.720793 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.720890 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.721098 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.721245 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.721397 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.721711 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.721801 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.722103 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.722192 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.722410 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.722600 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.722740 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.723040 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.723135 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.723378 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.723474 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.723737 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.723928 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.724059 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.724899 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.725101 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.725270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.725529 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.725891 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.725977 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.726226 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.726391 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.726709 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.726897 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.727128 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.727338 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.727426 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.727729 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.727824 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.728138 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.728299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.728444 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.728747 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.728845 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.729062 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.729191 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.729377 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.729669 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.729766 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.730004 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.730091 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.730310 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.730560 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.730653 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.730944 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.731040 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.731261 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.731432 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.731565 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.731871 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.731967 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.732261 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.732355 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.732579 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.732767 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.732905 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.733241 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.733332 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.733589 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.733715 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.733997 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.734135 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.734315 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.734629 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.734733 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.734973 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.735131 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.735329 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.735567 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.735655 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.735976 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.736078 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.736474 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.736570 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.736783 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.736989 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.737085 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.737396 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.737482 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.737697 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.737848 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.738002 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.738305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.738383 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.738637 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.738862 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.738964 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.739221 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.739307 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.739537 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.739765 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.739920 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.740945 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.741262 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.741353 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.741655 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.741751 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.741996 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.742159 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.742308 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.742644 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.742736 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.742960 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.743148 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.743284 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.743612 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.743701 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.744003 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.744098 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.744394 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.744482 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.744773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.744909 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.745091 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.745376 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.745467 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.745730 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.745825 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.746037 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.746249 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.746367 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.746737 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.746831 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.747118 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.747215 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.747434 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.747599 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.747788 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.748040 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.748129 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.748375 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.748558 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.748678 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.748995 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.749091 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.749309 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.749447 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.749608 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.749910 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.749997 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.750208 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.750353 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.750508 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.750816 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.750908 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.751154 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.751267 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.751563 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.751725 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.751888 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.752165 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.752255 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.752507 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.752601 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.752811 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.753043 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.753132 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.753460 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.753553 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.753774 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.753944 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.754112 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.754387 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.754476 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.754783 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.754885 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.755110 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.755314 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.755408 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.755858 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.756221 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.756363 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.756590 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.756816 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.756948 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.757304 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.757408 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.757687 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.757783 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.758040 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.758128 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.758376 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.758574 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.758710 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.759024 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.759121 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.759335 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.759526 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.759646 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.760021 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.760198 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.760491 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.760580 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.760822 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.760945 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.761131 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.761403 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.761492 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.761735 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.761851 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.762082 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.762328 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.762430 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.762780 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.762872 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.763205 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.763294 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.763604 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.763702 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.763972 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.764060 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.764294 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.764531 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.764629 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.764947 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.765034 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.765385 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.765515 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.765782 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.765879 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.766137 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.766288 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.766452 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.766772 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.766875 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.767133 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.767222 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.767439 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.767647 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.767734 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.768045 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.768140 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.768353 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.768768 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.768928 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.769255 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.769354 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.769564 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.769736 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.769895 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.770199 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.770295 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.770501 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.770698 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.770834 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.771124 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.771234 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.771473 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.771799 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.772115 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.772210 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.772441 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.772596 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.772753 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.773050 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.773139 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.773484 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.773660 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.773854 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.774034 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.774183 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.774485 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.774594 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.774839 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.774979 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.775152 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.775394 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.775494 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.775850 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.776040 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.776248 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.776479 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.776574 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.776926 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.777028 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.777176 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.777345 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.777584 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.777782 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.777873 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.778104 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.778366 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.778508 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.778876 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.779128 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.779419 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.779511 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.779591 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.779809 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.780028 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.780136 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.780357 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.780456 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.780744 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.780847 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.781078 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.781382 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.781501 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.781712 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.781796 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.781986 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.782102 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.782321 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.782515 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.782787 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.782996 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.783091 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.783187 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.783429 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.783517 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.783948 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.784057 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.784130 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.784338 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.784444 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.784637 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.784766 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.784986 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.785137 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.785357 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.785640 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.785756 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.785981 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.786085 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.786272 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.786454 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.786704 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.787332 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.787747 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.788276 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.788377 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.788575 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.788677 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.788868 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.789260 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.789360 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.789455 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.789757 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.789846 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.790065 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.790271 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.790388 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.790719 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.790945 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.791064 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.791262 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.791383 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.791685 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.791785 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.791982 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.792148 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.792486 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.792588 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.792775 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.792929 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.793138 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.793344 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.793474 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.793564 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.794091 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.794205 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.794284 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.794585 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.794825 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.794907 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.795048 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.795322 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.795436 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.795634 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.795735 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.795986 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.796155 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.796290 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.796592 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.796688 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.796896 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.797085 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.797214 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.797520 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.797681 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.797860 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.798145 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.798241 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.798455 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.798627 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.798785 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.799089 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.799178 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.799401 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.799648 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.799737 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.799993 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.800080 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.800294 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.800557 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.800653 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.800886 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.801004 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.801188 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.801469 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.801558 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.801815 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.801914 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.802128 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.802353 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.802597 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.802992 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.803310 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.803412 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.803628 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.803756 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.803937 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.804214 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.804309 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.804539 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.804635 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.804850 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.805066 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.805198 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.805498 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.805588 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.805845 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.805932 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.806275 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.806418 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.806607 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.806912 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.807001 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.807228 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.807363 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.807533 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.807836 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.807927 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.808158 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.808296 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.808464 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.808738 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.808827 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.809119 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.809220 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.809397 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.809667 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.809759 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.810065 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.810167 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.810385 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.810632 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.810721 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.811003 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.811101 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.811324 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.811515 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.811630 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.811944 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.812033 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.812247 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.812406 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.812547 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.812867 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.813022 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.813322 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.813410 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.813639 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.813780 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.813939 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.814241 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.814328 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.814559 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.814765 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.814881 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.815188 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.815288 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.815488 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.815652 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.815785 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.816084 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.816180 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.816381 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.816608 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.816695 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.816989 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.817075 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.817288 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.817476 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.817588 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.817884 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.817977 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.818742 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.819006 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.819150 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.819358 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.819683 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.819821 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.819994 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.820199 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.820311 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.820617 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.820704 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.820956 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.821114 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.821265 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.821557 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.821654 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.821887 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.822004 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.822197 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.822448 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.822559 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.822869 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.822956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.823197 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.823354 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.823504 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.823801 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.823890 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.824105 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.824254 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.824410 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.824695 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.824783 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.825023 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.825190 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.825345 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.825631 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.825728 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.825954 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.826124 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.826269 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.826630 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.826722 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.826942 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.827115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.827248 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.827570 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.827675 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.827892 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.828003 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.828195 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.828474 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.828637 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.828796 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.828957 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.829101 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.829399 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.829491 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.829708 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.829870 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.830030 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.830334 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.830423 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.830691 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.830894 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.831031 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.831342 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.831430 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.831687 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.831783 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.832013 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.832210 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.832339 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.832655 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.832744 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.832964 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.833187 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.833277 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.833558 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.833903 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:37:48.834045 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.836058 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.836413 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.836752 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.837079 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.837403 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.837727 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.838048 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.838369 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.838717 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.839036 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.839353 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.839688 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.840015 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.840346 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.840688 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.841010 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.841327 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.841645 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.841962 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.842322 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.842666 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.842979 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.843295 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.843613 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.843930 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.844245 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.844558 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.844874 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.845190 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.845503 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.845831 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.846135 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.846450 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.846798 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.847135 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.847457 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.847774 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.848090 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.848406 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.848923 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.849237 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.850668 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.851006 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.851337 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.851657 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.851979 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.852311 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.852621 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.852931 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.853246 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.853557 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.853863 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.854186 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.854498 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.854826 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.855147 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.855458 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.855992 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.856347 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.856665 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.856993 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.857318 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.857635 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.857941 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.858264 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.858590 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.858898 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.859212 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.859523 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.859827 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.860131 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.860443 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.860745 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.861049 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.861359 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.861661 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.861985 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.862289 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.862619 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.862925 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.863237 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.863540 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.863843 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.864145 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.864446 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.864757 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.866195 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.866572 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.866862 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.867191 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.867513 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.867823 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.868183 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.868513 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.868821 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.869132 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.869447 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.869762 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.870084 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.870419 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.870736 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.871087 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.871403 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.871937 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.872270 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.872590 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.872925 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.873255 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.873565 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.873871 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.874181 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.874503 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.874834 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.875145 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.875453 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.875760 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.876069 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.876377 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.876685 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.876999 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.877307 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.877615 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.877922 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.878229 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.878627 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.878943 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.879255 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.879575 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.879891 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.880207 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.880536 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.881393 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.881714 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.882032 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.882346 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.882706 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.883041 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.883357 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.883663 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.884090 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.884404 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.884723 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.885042 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.885351 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.885673 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.885995 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.886306 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.886655 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.886967 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.887300 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.887640 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.887969 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.888295 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.888601 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.888908 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.889212 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.889521 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.889838 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.890147 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.890449 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.890775 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.891082 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.891385 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.891689 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.891992 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.892294 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.892599 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.892899 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.893202 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.893760 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.894069 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.894166 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO dbcounter [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Registered counter for database nova_api May 26 12:37:48.894371 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.894700 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.895007 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.895309 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.895613 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.895915 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.896247 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.896997 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.897339 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.897677 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.897996 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.898323 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.898665 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.898998 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.899308 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.899636 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.899967 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.900285 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.900595 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.900930 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.901239 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.901548 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.901856 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.902171 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.902476 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.902812 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.903139 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.903465 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.903768 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.904093 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.904414 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.904730 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.905044 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.905354 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.905685 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.905999 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.906306 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.906649 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.906967 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.907280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.907596 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.907916 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.908235 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.908565 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.908917 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.909197 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.909524 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.909871 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.910201 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.910562 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.910949 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.911197 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.911563 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.912321 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:37:48.913188 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:37:48.917142 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_db.sqlalchemy.engines [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:48.924009 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writer thread running {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:48.975169 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO dbcounter [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Registered counter for database nova_api May 26 12:37:48.982100 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.context [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e72b17b-274a-4fb6-89bb-8004b3c5f49b(cell1) {{(pid=110325) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:37:48.986218 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:48.987812 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:48.988595 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:48.990658 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:48.992684 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO dbcounter [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Registered counter for database nova_cell0 May 26 12:37:48.995416 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG oslo_db.sqlalchemy.engines [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:48.996792 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO dbcounter [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Registered counter for database nova_cell1 May 26 12:37:49.001972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writer thread running {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:49.003994 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_db.sqlalchemy.engines [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:49.006846 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_db.sqlalchemy.engines [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:49.012537 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writer thread running {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:49.014672 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writer thread running {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:49.062898 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.context [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e72b17b-274a-4fb6-89bb-8004b3c5f49b(cell1) {{(pid=110326) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:37:49.067000 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG oslo_concurrency.lockutils [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:49.069155 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG oslo_concurrency.lockutils [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:49.069959 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG oslo_concurrency.lockutils [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:49.071983 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG oslo_concurrency.lockutils [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:49.073974 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO dbcounter [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Registered counter for database nova_cell0 May 26 12:37:49.077987 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO dbcounter [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Registered counter for database nova_cell1 May 26 12:37:49.085172 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG oslo_db.sqlalchemy.engines [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:49.087004 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG oslo_db.sqlalchemy.engines [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:49.093731 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writer thread running {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:49.096263 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writer thread running {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:49.162610 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO dbcounter [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Registered counter for database nova_cell0 May 26 12:37:49.171752 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_db.sqlalchemy.engines [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:49.178550 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writer thread running {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:49.252356 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO dbcounter [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Registered counter for database nova_cell0 May 26 12:37:49.262431 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG oslo_db.sqlalchemy.engines [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:37:49.266902 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writer thread running {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:37:49.625179 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: WARNING keystonemiddleware.auth_token [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:37:49.633490 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: WARNING keystonemiddleware.auth_token [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:37:49.700803 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: WARNING keystonemiddleware.auth_token [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:37:49.708533 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: WARNING keystonemiddleware.auth_token [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:37:49.999081 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: WARNING keystonemiddleware.auth_token [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:37:50.006185 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: WARNING keystonemiddleware.auth_token [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:37:50.013968 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55845116b9c0 pid: 110325 (default app) May 26 12:37:50.016094 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:50.017278 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001764 May 26 12:37:50.017693 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Thu May 26 12:37:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:50.058899 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: WARNING keystonemiddleware.auth_token [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:37:50.064984 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: WARNING keystonemiddleware.auth_token [None req-e1795fb1-8bbc-4807-b232-344020d7f878 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:37:50.071172 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55845116b9c0 pid: 110326 (default app) May 26 12:39:17.820467 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:17.822436 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002874 May 26 12:39:17.824133 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:17 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:17.842569 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writing DB stats nova_api:SELECT=3 {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:17.843502 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writing DB stats nova_cell0:SELECT=3 {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:17.844490 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writing DB stats nova_cell1:SELECT=3 {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:17.845311 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:18.329541 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-ebf49e9e-179f-46b8-b007-7ed3d36286d8 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:18.365928 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-ebf49e9e-179f-46b8-b007-7ed3d36286d8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.533319 May 26 12:39:18.367047 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Thu May 26 12:39:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:20.989131 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:20.990057 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-e285a02f-1bb1-48e7-9988-9838af7b3992 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 26 12:39:20.990458 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:21.060303 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-53b4fa92-4c42-4802-a02f-b8bde8e441ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "vcpus": 1, "disk": 1}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:21.080249 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:39:21.080249 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: warnings.warn(msg) May 26 12:39:21.170771 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-53b4fa92-4c42-4802-a02f-b8bde8e441ee admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.173715 May 26 12:39:21.178893 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:21.185565 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_api:SELECT=3 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:21.186556 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_cell0:SELECT=3 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:21.187524 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_cell1:SELECT=3 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:21.188985 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:21.402518 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-c6c515c1-ab7f-4fb6-8f24-d469d186ae79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:21.404962 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:39:21.404962 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: warnings.warn(msg) May 26 12:39:21.525367 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-c6c515c1-ab7f-4fb6-8f24-d469d186ae79 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.345212 May 26 12:39:21.526418 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 26 12:39:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:23.842256 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-53b4fa92-4c42-4802-a02f-b8bde8e441ee admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:23.843335 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-53b4fa92-4c42-4802-a02f-b8bde8e441ee admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 26 12:39:23.843742 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:23.956379 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-4d63da50-a42c-4632-a725-e00d9d3d6feb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "name": "ds512M", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:23.974643 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:39:23.974643 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: warnings.warn(msg) May 26 12:39:24.088564 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-4d63da50-a42c-4632-a725-e00d9d3d6feb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.238345 May 26 12:39:24.089043 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:24.103052 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-2dc18203-0c88-41dc-ab52-aaae6c96c6dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:24.104593 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:39:24.104593 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: warnings.warn(msg) May 26 12:39:24.218031 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-2dc18203-0c88-41dc-ab52-aaae6c96c6dc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120253 May 26 12:39:24.218849 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 26 12:39:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:26.531816 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-4d63da50-a42c-4632-a725-e00d9d3d6feb admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:26.532770 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-4d63da50-a42c-4632-a725-e00d9d3d6feb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 26 12:39:26.533204 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:39:26.605529 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-d847988b-1d2e-4748-8c14-930b16f53468 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 1024}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:26.711357 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-d847988b-1d2e-4748-8c14-930b16f53468 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.171181 May 26 12:39:26.712211 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:26.724305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-ba1fb66a-44e4-4670-be9f-12371ad51a60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:26.828217 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-ba1fb66a-44e4-4670-be9f-12371ad51a60 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107831 May 26 12:39:26.828950 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 26 12:39:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:29.217378 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-d847988b-1d2e-4748-8c14-930b16f53468 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:29.218342 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-d847988b-1d2e-4748-8c14-930b16f53468 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 May 26 12:39:29.218764 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:29.283026 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-6489c27a-f010-4259-9e24-cc95f3482aa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:29.386876 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-6489c27a-f010-4259-9e24-cc95f3482aa9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161093 May 26 12:39:29.387435 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:39:29.400530 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-65c7c646-6fa8-46f3-9d39-3d0d81d0d784 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:29.538326 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-65c7c646-6fa8-46f3-9d39-3d0d81d0d784 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142214 May 26 12:39:29.539065 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 26 12:39:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:39:31.859918 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-6489c27a-f010-4259-9e24-cc95f3482aa9 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:31.861612 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-6489c27a-f010-4259-9e24-cc95f3482aa9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 May 26 12:39:31.862190 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:31.928445 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-2e693e37-682e-47b7-8047-e24308495e62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 4096, "id": "d4", "name": "ds4G", "vcpus": 4}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:32.028334 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-2e693e37-682e-47b7-8047-e24308495e62 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159043 May 26 12:39:32.031030 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:32.042550 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-958b7d09-9db0-420c-b7dd-b514e6130787 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:32.155083 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-958b7d09-9db0-420c-b7dd-b514e6130787 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116268 May 26 12:39:32.164035 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 26 12:39:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:34.527753 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-2e693e37-682e-47b7-8047-e24308495e62 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:34.529146 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-2e693e37-682e-47b7-8047-e24308495e62 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 May 26 12:39:34.529945 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:34.601959 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-95cf3936-32d7-4ea7-9712-a16afbdaea69 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:34.625921 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-95cf3936-32d7-4ea7-9712-a16afbdaea69 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087327 May 26 12:39:34.626452 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Thu May 26 12:39:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:37.015956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-2e693e37-682e-47b7-8047-e24308495e62 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:37.017011 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-2e693e37-682e-47b7-8047-e24308495e62 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 May 26 12:39:37.017510 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:37.087015 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-83d7f044-ee72-412a-a6fd-e5784409f402 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:37.189907 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-83d7f044-ee72-412a-a6fd-e5784409f402 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.164693 May 26 12:39:37.190500 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:37.204539 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-e42affbb-3c65-4b46-a6bf-6577b07b3fae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:37.303951 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-e42affbb-3c65-4b46-a6bf-6577b07b3fae admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103180 May 26 12:39:37.304552 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 26 12:39:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:39:39.646955 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-83d7f044-ee72-412a-a6fd-e5784409f402 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:39.648124 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-83d7f044-ee72-412a-a6fd-e5784409f402 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 May 26 12:39:39.648550 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:39.740006 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-6f3dfcba-0c44-43db-80c3-6e5318d12c00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:39.940270 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-6f3dfcba-0c44-43db-80c3-6e5318d12c00 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.283105 May 26 12:39:40.034100 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:40.034504 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-1995e58f-b902-4b44-a8c7-2e79c81516fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:40.241964 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-1995e58f-b902-4b44-a8c7-2e79c81516fd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291972 May 26 12:39:40.242584 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 26 12:39:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:42.612509 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-6f3dfcba-0c44-43db-80c3-6e5318d12c00 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:42.613691 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-6f3dfcba-0c44-43db-80c3-6e5318d12c00 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 May 26 12:39:42.614201 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:42.680483 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-cd245d7d-93aa-40b0-b124-e35c49b2b661 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:42.785706 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-cd245d7d-93aa-40b0-b124-e35c49b2b661 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.159406 May 26 12:39:42.785706 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:42.794407 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-f71bdb4a-529d-4e25-a262-3bb701c673bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:42.965557 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-f71bdb4a-529d-4e25-a262-3bb701c673bc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.174999 May 26 12:39:42.966160 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 26 12:39:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:39:45.298683 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-cd245d7d-93aa-40b0-b124-e35c49b2b661 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:45.299723 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-cd245d7d-93aa-40b0-b124-e35c49b2b661 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 26 12:39:45.300119 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:45.367767 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-a16e2544-7aa4-4c88-9d50-82329d9798fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:45.442190 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-a16e2544-7aa4-4c88-9d50-82329d9798fd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135151 May 26 12:39:45.442665 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:45.454836 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-875e435b-cf9b-4629-9b00-3f93dfacf141 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:45.594980 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-875e435b-cf9b-4629-9b00-3f93dfacf141 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143794 May 26 12:39:45.595571 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 26 12:39:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:48.048994 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-a16e2544-7aa4-4c88-9d50-82329d9798fd admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:48.050723 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-a16e2544-7aa4-4c88-9d50-82329d9798fd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 May 26 12:39:48.058646 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:39:48.118399 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-d388a2bb-cbf2-4e92-9871-cd0978c79c1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge"}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:48.456109 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-d388a2bb-cbf2-4e92-9871-cd0978c79c1c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.398097 May 26 12:39:48.456668 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 26 12:39:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:48.469679 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-c39a12ac-7925-42b6-a664-5c949dbca151 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:48.473724 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:48.607210 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-c39a12ac-7925-42b6-a664-5c949dbca151 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141101 May 26 12:39:48.607919 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 26 12:39:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:14.069657 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-d388a2bb-cbf2-4e92-9871-cd0978c79c1c admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:14.070701 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-d388a2bb-cbf2-4e92-9871-cd0978c79c1c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 May 26 12:40:14.071102 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:40:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:40:14.132766 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3b708f35-e5b3-49ea-9f81-7b72019d2306 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:14.150569 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3b708f35-e5b3-49ea-9f81-7b72019d2306 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073023 May 26 12:40:14.153474 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Thu May 26 12:40:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:15.171281 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-d388a2bb-cbf2-4e92-9871-cd0978c79c1c admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:15.172295 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-d388a2bb-cbf2-4e92-9871-cd0978c79c1c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 26 12:40:15.172692 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:40:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:15.372128 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-0d0036cc-8c83-4701-ab00-7347213c8588 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:15.378082 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.wsgi [None req-0d0036cc-8c83-4701-ab00-7347213c8588 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-0d0036cc-8c83-4701-ab00-7347213c8588 admin admin] Request method failure captured: May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Accept: application/json May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Accept-Encoding: gzip, deflate May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Connection: keep-alive May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Content-Length: 0 May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Host: 10.222.0.60 May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Openstack-Api-Version: compute 2.90 May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Openstack-System-Scope: None May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: User-Agent: python-novaclient May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Auth-Token: gAAAAABij3Uv1WB9wH5tgJf8MjkP-X81_oOil9h_k5SnIGaHTxNlXDBzo-kYYfbPGNr4-lLOxbAhXffkvKWwEpXa6rmTrLflXWCLvSnPuqr-t3edxK3fzbg-oulg-Ag48N3CW0ptOjskk_pT-0ISN42Xhu1-JWjEkyzEF1pF86lu9JyJdO9L2-o May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Domain-Id: None May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Domain-Name: None May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Identity-Status: Confirmed May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Is-Admin-Project: True May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Domain-Id: default May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Domain-Name: Default May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Name: admin May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Role: reader,member,admin May 26 12:40:15.381480 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Roles: reader,member,admin May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant: admin May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant-Name: admin May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User: admin May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Domain-Id: default May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Domain-Name: Default May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Id: bc7504a99e7249a395b2c1252117a52e May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Name: admin May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: method: > May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: exception: Flavor 42 could not be found. May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: action_args: {'id': '42'} May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:15.384280 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:15.385884 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:15.388115 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-0d0036cc-8c83-4701-ab00-7347213c8588 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:15.390162 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-0d0036cc-8c83-4701-ab00-7347213c8588 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067811 May 26 12:40:15.390162 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Thu May 26 12:40:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:40:15.393325 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-ecb5e110-01db-4ab1-8cc8-b424c8732391 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:15.396581 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:15.415932 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-ecb5e110-01db-4ab1-8cc8-b424c8732391 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026153 May 26 12:40:15.416509 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 26 12:40:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:15.426495 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3ac331e0-6c2c-48a6-b39f-dafd79ef0798 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:15.449377 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3ac331e0-6c2c-48a6-b39f-dafd79ef0798 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026392 May 26 12:40:15.449939 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 26 12:40:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:40:15.460240 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-bc342000-3d86-4a4f-b08c-ded7764ec4c5 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:15.466423 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.wsgi [None req-bc342000-3d86-4a4f-b08c-ded7764ec4c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-bc342000-3d86-4a4f-b08c-ded7764ec4c5 admin admin] Request method failure captured: May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Accept: application/json May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Accept-Encoding: gzip, deflate May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Connection: keep-alive May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Content-Length: 0 May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Host: 10.222.0.60 May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Openstack-Api-Version: compute 2.90 May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Openstack-System-Scope: None May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: User-Agent: python-novaclient May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Auth-Token: gAAAAABij3Uv1WB9wH5tgJf8MjkP-X81_oOil9h_k5SnIGaHTxNlXDBzo-kYYfbPGNr4-lLOxbAhXffkvKWwEpXa6rmTrLflXWCLvSnPuqr-t3edxK3fzbg-oulg-Ag48N3CW0ptOjskk_pT-0ISN42Xhu1-JWjEkyzEF1pF86lu9JyJdO9L2-o May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Domain-Id: None May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Domain-Name: None May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Identity-Status: Confirmed May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Is-Admin-Project: True May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Domain-Id: default May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Domain-Name: Default May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Name: admin May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Role: reader,member,admin May 26 12:40:15.469773 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Roles: reader,member,admin May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant: admin May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant-Name: admin May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User: admin May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Domain-Id: default May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Domain-Name: Default May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Id: bc7504a99e7249a395b2c1252117a52e May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Name: admin May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: method: > May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: exception: Flavor 42 could not be found. May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: action_args: {'id': '42'} May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:15.471437 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:15.472305 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:15.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-bc342000-3d86-4a4f-b08c-ded7764ec4c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110325) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:15.476181 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-bc342000-3d86-4a4f-b08c-ded7764ec4c5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015203 May 26 12:40:15.476181 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Thu May 26 12:40:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:40:16.368677 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3ac331e0-6c2c-48a6-b39f-dafd79ef0798 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:16.369682 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3ac331e0-6c2c-48a6-b39f-dafd79ef0798 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 26 12:40:16.370077 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:40:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:16.571306 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-6737723d-c265-4b30-8eba-ca578db942bf admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:16.576892 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.wsgi [None req-6737723d-c265-4b30-8eba-ca578db942bf admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-6737723d-c265-4b30-8eba-ca578db942bf admin admin] Request method failure captured: May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Accept: application/json May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Accept-Encoding: gzip, deflate May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Connection: keep-alive May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Content-Length: 0 May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Host: 10.222.0.60 May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Openstack-Api-Version: compute 2.90 May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Openstack-System-Scope: None May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: User-Agent: python-novaclient May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Auth-Token: gAAAAABij3Uwos9if-LUULxYWYObXvgS1s-4IEezI0HGUuMmwetzE5TBoG9WCVZX7yUuQWs5RD5VZKpu_49RPn26ST-nnd2shSHnPEvqM8Xpy0hCsyDI7mF8qKWxodi4U9XbODAbu6V9h86S4e4ekVug6HEU1iiRFaPenXC-ldRIT3d_-WE33wU May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Domain-Id: None May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Domain-Name: None May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Identity-Status: Confirmed May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Is-Admin-Project: True May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Domain-Id: default May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Domain-Name: Default May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Name: admin May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Role: reader,member,admin May 26 12:40:16.578415 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Roles: reader,member,admin May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant: admin May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant-Name: admin May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User: admin May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Domain-Id: default May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Domain-Name: Default May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Id: bc7504a99e7249a395b2c1252117a52e May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Name: admin May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: method: > May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: exception: Flavor 84 could not be found. May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: action_args: {'id': '84'} May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:16.580779 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:16.582390 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:16.585236 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-6737723d-c265-4b30-8eba-ca578db942bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110325) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:16.587527 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-6737723d-c265-4b30-8eba-ca578db942bf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068210 May 26 12:40:16.587527 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Thu May 26 12:40:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:40:16.592526 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-1970e906-cfcc-4841-91e8-c73d80ca6be2 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:16.608135 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-1970e906-cfcc-4841-91e8-c73d80ca6be2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019169 May 26 12:40:16.608688 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 26 12:40:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:16.619223 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-42d96e24-750a-4593-869f-7127a9f9322a admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:16.635092 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-42d96e24-750a-4593-869f-7127a9f9322a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020125 May 26 12:40:16.635642 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 26 12:40:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:16.647073 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-90858f70-b4bc-48b3-9322-b0ee522bd610 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:16.652584 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.wsgi [None req-90858f70-b4bc-48b3-9322-b0ee522bd610 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-90858f70-b4bc-48b3-9322-b0ee522bd610 admin admin] Request method failure captured: May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Accept: application/json May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Accept-Encoding: gzip, deflate May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Connection: keep-alive May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Content-Length: 0 May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Host: 10.222.0.60 May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Openstack-Api-Version: compute 2.90 May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Openstack-System-Scope: None May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: User-Agent: python-novaclient May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Auth-Token: gAAAAABij3Uwos9if-LUULxYWYObXvgS1s-4IEezI0HGUuMmwetzE5TBoG9WCVZX7yUuQWs5RD5VZKpu_49RPn26ST-nnd2shSHnPEvqM8Xpy0hCsyDI7mF8qKWxodi4U9XbODAbu6V9h86S4e4ekVug6HEU1iiRFaPenXC-ldRIT3d_-WE33wU May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Domain-Id: None May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Domain-Name: None May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Identity-Status: Confirmed May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Is-Admin-Project: True May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Domain-Id: default May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Domain-Name: Default May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Name: admin May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Role: reader,member,admin May 26 12:40:16.654370 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Roles: reader,member,admin May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant: admin May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant-Name: admin May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User: admin May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Domain-Id: default May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Domain-Name: Default May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Id: bc7504a99e7249a395b2c1252117a52e May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Name: admin May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: method: > May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: exception: Flavor 84 could not be found. May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: action_args: {'id': '84'} May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:16.655956 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:16.656921 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:16.657972 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-90858f70-b4bc-48b3-9322-b0ee522bd610 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:16.659021 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-90858f70-b4bc-48b3-9322-b0ee522bd610 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012722 May 26 12:40:16.659021 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Thu May 26 12:40:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:40:17.548365 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-42d96e24-750a-4593-869f-7127a9f9322a admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:17.549376 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-42d96e24-750a-4593-869f-7127a9f9322a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 26 12:40:17.549798 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:40:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:17.746003 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-434e79e7-5b8a-4983-8cfc-5d684cf60133 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:17.751793 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.wsgi [None req-434e79e7-5b8a-4983-8cfc-5d684cf60133 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-434e79e7-5b8a-4983-8cfc-5d684cf60133 admin admin] Request method failure captured: May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Accept: application/json May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Accept-Encoding: gzip, deflate May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Connection: keep-alive May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Content-Length: 0 May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Host: 10.222.0.60 May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Openstack-Api-Version: compute 2.90 May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Openstack-System-Scope: None May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: User-Agent: python-novaclient May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Auth-Token: gAAAAABij3UxDE7N3xT6LXGfXn0Z8Bd8Q_paBCNGv5UWVTVjJMlvo8XzhSlyGkSYlokMFV7r6-x0ljlMmD0JaYPSws3mhG4bnDlE59fUZNQq3yL2u44YOEDGNGTb1MPfndfV5-vgBDr2xo_Ic7NvgCb3e13uQ6oPLfe6dEj8y_mEb35RUqT-4F8 May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Domain-Id: None May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Domain-Name: None May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Identity-Status: Confirmed May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Is-Admin-Project: True May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Domain-Id: default May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Domain-Name: Default May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Project-Name: admin May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Role: reader,member,admin May 26 12:40:17.753299 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Roles: reader,member,admin May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant: admin May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-Tenant-Name: admin May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User: admin May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Domain-Id: default May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Domain-Name: Default May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Id: bc7504a99e7249a395b2c1252117a52e May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: X-User-Name: admin May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: method: > May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: exception: Flavor 451 could not be found. May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: action_args: {'id': '451'} May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:17.754892 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:17.756460 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: ERROR nova.api.openstack.wsgi May 26 12:40:17.758282 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-434e79e7-5b8a-4983-8cfc-5d684cf60133 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:17.759593 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-434e79e7-5b8a-4983-8cfc-5d684cf60133 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063735 May 26 12:40:17.759593 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 26 12:40:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:40:17.767542 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-ac45079a-8f73-41da-aa93-98f138387e39 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:17.783893 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-ac45079a-8f73-41da-aa93-98f138387e39 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019871 May 26 12:40:17.784421 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 26 12:40:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:17.794070 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:17.809113 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018648 May 26 12:40:17.809660 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 26 12:40:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:17.819604 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-b11c42bb-a195-4d3b-97e9-d21324bcd1c1 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:17.825096 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.wsgi [None req-b11c42bb-a195-4d3b-97e9-d21324bcd1c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-b11c42bb-a195-4d3b-97e9-d21324bcd1c1 admin admin] Request method failure captured: May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Accept: application/json May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Accept-Encoding: gzip, deflate May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Connection: keep-alive May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Content-Length: 0 May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Host: 10.222.0.60 May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Openstack-Api-Version: compute 2.90 May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Openstack-System-Scope: None May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: User-Agent: python-novaclient May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Auth-Token: gAAAAABij3UxDE7N3xT6LXGfXn0Z8Bd8Q_paBCNGv5UWVTVjJMlvo8XzhSlyGkSYlokMFV7r6-x0ljlMmD0JaYPSws3mhG4bnDlE59fUZNQq3yL2u44YOEDGNGTb1MPfndfV5-vgBDr2xo_Ic7NvgCb3e13uQ6oPLfe6dEj8y_mEb35RUqT-4F8 May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Domain-Id: None May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Domain-Name: None May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Identity-Status: Confirmed May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Is-Admin-Project: True May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Domain-Id: default May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Domain-Name: Default May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Project-Name: admin May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Role: reader,member,admin May 26 12:40:17.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Roles: reader,member,admin May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4d4adba733e41f4aa7039514b116efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant: admin May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant-Id: d4d4adba733e41f4aa7039514b116efa May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-Tenant-Name: admin May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User: admin May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Domain-Id: default May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Domain-Name: Default May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Id: bc7504a99e7249a395b2c1252117a52e May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: X-User-Name: admin May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: method: > May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: exception: Flavor 451 could not be found. May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: action_args: {'id': '451'} May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:17.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:17.829126 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: ERROR nova.api.openstack.wsgi May 26 12:40:17.830403 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-b11c42bb-a195-4d3b-97e9-d21324bcd1c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110325) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:17.831595 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-b11c42bb-a195-4d3b-97e9-d21324bcd1c1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012514 May 26 12:40:17.831595 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 26 12:40:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:40:18.706451 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:18.707486 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 26 12:40:18.707875 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:18.902553 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-37d2cae7-51e6-4780-bd41-7f8c5cc8fe11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:18.985534 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-37d2cae7-51e6-4780-bd41-7f8c5cc8fe11 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.137365 May 26 12:40:18.985998 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Thu May 26 12:40:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:40:19.879643 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:19.880642 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 26 12:40:19.881742 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:20.075477 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-2b4cf700-de9b-4e8c-801e-a6e478f63455 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:20.168761 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-2b4cf700-de9b-4e8c-801e-a6e478f63455 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.147637 May 26 12:40:20.169312 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Thu May 26 12:40:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:40:21.066204 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:21.067276 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 26 12:40:21.067681 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:40:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:21.267747 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-fca6e2b9-3fc3-46e2-b50d-8b411e8bfc32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:21.362109 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-fca6e2b9-3fc3-46e2-b50d-8b411e8bfc32 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.153592 May 26 12:40:21.362678 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Thu May 26 12:40:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:40:22.292456 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:22.293473 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 26 12:40:22.293877 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:22.511775 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-e0c3b476-13b2-4e70-96f9-4da61cd01e67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:22.591660 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-e0c3b476-13b2-4e70-96f9-4da61cd01e67 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.134809 May 26 12:40:22.592206 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Thu May 26 12:40:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:40:23.495555 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:23.496769 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001847 May 26 12:40:23.497175 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:40:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:23.695903 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-097a4573-0706-4e46-aa82-ffd73227c41b admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:23.715338 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-097a4573-0706-4e46-aa82-ffd73227c41b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076177 May 26 12:40:23.715879 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Thu May 26 12:40:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:41:27.327311 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:27.328342 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-3efc8caf-ef42-4a4d-a2fa-078bd33c708c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 26 12:41:27.328730 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 26 12:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:27.337265 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:27.388865 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-bd02557f-3e8e-4aa8-ba6e-654d8a953dfd admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:27.413474 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-bd02557f-3e8e-4aa8-ba6e-654d8a953dfd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078316 May 26 12:41:27.414025 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Thu May 26 12:41:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:41:27.434161 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG dbcounter [-] [110326] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:27.437947 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-2ad965b9-bf00-46f9-80c1-c7e648a4a433 admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:27.446350 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-2ad965b9-bf00-46f9-80c1-c7e648a4a433 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013589 May 26 12:41:27.447763 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Thu May 26 12:41:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:27.458835 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-19fcd592-a391-4e03-9585-95771892bcb7 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:27.467194 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-19fcd592-a391-4e03-9585-95771892bcb7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012328 May 26 12:41:27.467725 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Thu May 26 12:41:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:27.479222 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:27.487251 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011884 May 26 12:41:27.487761 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Thu May 26 12:41:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:27.500950 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-d7d029c1-a357-46d5-b1c0-43e28e494a17 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:27.509392 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-d7d029c1-a357-46d5-b1c0-43e28e494a17 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012046 May 26 12:41:27.509920 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Thu May 26 12:41:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:24.191806 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:24.192822 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 26 12:45:24.193216 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:45:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:24.353862 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_api:SELECT=6 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:24.473959 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-13beba6e-47d8-4e47-b4a9-f085a0ae6d6f admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:24.475168 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:45:24.475168 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: warnings.warn(msg) May 26 12:45:24.476380 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-13beba6e-47d8-4e47-b4a9-f085a0ae6d6f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:24.476813 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-13beba6e-47d8-4e47-b4a9-f085a0ae6d6f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:24.477581 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-13beba6e-47d8-4e47-b4a9-f085a0ae6d6f admin admin] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:24.478015 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-13beba6e-47d8-4e47-b4a9-f085a0ae6d6f admin admin] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:24.512385 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-13beba6e-47d8-4e47-b4a9-f085a0ae6d6f admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.159943 May 26 12:45:24.512954 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 26 12:45:24 2022] GET /compute/v2.1/os-services => generated 794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:45:25.417623 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:25.418668 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 May 26 12:45:25.419073 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:45:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:25.630341 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-6e4d4512-9e8c-4e83-bd2d-bb24ad10bef4 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:25.631601 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:45:25.631601 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: warnings.warn(msg) May 26 12:45:25.632777 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-6e4d4512-9e8c-4e83-bd2d-bb24ad10bef4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:25.633210 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-6e4d4512-9e8c-4e83-bd2d-bb24ad10bef4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:25.633978 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-6e4d4512-9e8c-4e83-bd2d-bb24ad10bef4 admin admin] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:25.634429 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-6e4d4512-9e8c-4e83-bd2d-bb24ad10bef4 admin admin] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:25.654547 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-6e4d4512-9e8c-4e83-bd2d-bb24ad10bef4 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.088087 May 26 12:45:25.655152 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 26 12:45:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:45:36.978024 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:36.979082 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 26 12:45:36.979490 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:45:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:37.120692 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_cell0:SELECT=4 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:37.121356 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_cell1:SELECT=4 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:37.121969 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG dbcounter [-] [110325] Writing DB stats nova_api:SELECT=8 {{(pid=110325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:37.171761 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-149f3763-e839-40ff-8fa5-74610a3a5825 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:37.173551 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:45:37.173551 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: warnings.warn(msg) May 26 12:45:37.174755 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-149f3763-e839-40ff-8fa5-74610a3a5825 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:37.175218 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-149f3763-e839-40ff-8fa5-74610a3a5825 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:37.176373 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-149f3763-e839-40ff-8fa5-74610a3a5825 admin admin] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:37.176822 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-149f3763-e839-40ff-8fa5-74610a3a5825 admin admin] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:37.202637 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-149f3763-e839-40ff-8fa5-74610a3a5825 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086410 May 26 12:45:37.203244 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 26 12:45:37 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:45:38.237974 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: DEBUG nova.api.openstack.wsgi [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] Calling method '>' {{(pid=110326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:38.239023 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: INFO nova.api.openstack.requestlog [None req-39acfe92-8188-4e49-a505-b3f3c51aa2ff admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 26 12:45:38.239417 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: [pid: 110326|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 26 12:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:38.433919 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG nova.api.openstack.wsgi [None req-cd865c6e-64fc-47d2-ac51-fab1e67b09c6 admin admin] Calling method '>' {{(pid=110325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:38.435141 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:45:38.435141 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: warnings.warn(msg) May 26 12:45:38.436360 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-cd865c6e-64fc-47d2-ac51-fab1e67b09c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:38.436800 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-cd865c6e-64fc-47d2-ac51-fab1e67b09c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:38.438189 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-cd865c6e-64fc-47d2-ac51-fab1e67b09c6 admin admin] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:38.438644 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: DEBUG oslo_concurrency.lockutils [None req-cd865c6e-64fc-47d2-ac51-fab1e67b09c6 admin admin] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:38.460011 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: INFO nova.api.openstack.requestlog [None req-cd865c6e-64fc-47d2-ac51-fab1e67b09c6 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079148 May 26 12:45:38.460570 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: [pid: 110325|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 26 12:45:38 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:38.813765 dv-cinder-815146-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 12:46:38.814476 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: Thu May 26 12:46:38 2022 - graceful shutdown triggered... May 26 12:46:38.815076 dv-cinder-815146-11-iscsi devstack@n-api.service[110325]: Gracefully killing worker 1 (pid: 110325)... May 26 12:46:38.815502 dv-cinder-815146-11-iscsi devstack@n-api.service[110326]: Gracefully killing worker 2 (pid: 110326)... May 26 12:46:39.815529 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: worker 1 buried after 1 seconds May 26 12:46:39.815529 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: worker 2 buried after 1 seconds May 26 12:46:39.816092 dv-cinder-815146-11-iscsi devstack@n-api.service[110324]: goodbye to uWSGI. May 26 12:46:39.817296 dv-cinder-815146-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 12:46:39.817898 dv-cinder-815146-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 12:46:39.820705 dv-cinder-815146-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 12:46:39.837733 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:46:39 2022] *** May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: nodename: dv-cinder-815146-11-iscsi May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: machine: x86_64 May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: clock source: unix May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: pcre jit disabled May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: detected number of CPU cores: 4 May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: current working directory: / May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: detected binary path: /usr/bin/uwsgi-core May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: your processes number limit is 47680 May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: your memory page size is 4096 bytes May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: detected max file descriptor number: 2048 May 26 12:46:39.869987 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: lock engine: pthread robust mutexes May 26 12:46:39.871412 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: thunder lock: enabled May 26 12:46:39.871412 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 12:46:39.871412 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:46:39.916705 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: Python main interpreter initialized at 0x5646e2d579c0 May 26 12:46:39.916705 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: python threads support enabled May 26 12:46:39.916705 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: your server socket listen backlog is limited to 100 connections May 26 12:46:39.916705 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: your mercy for graceful operations on workers is 90 seconds May 26 12:46:39.917168 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:46:39.917168 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: *** Operational MODE: preforking *** May 26 12:46:39.917385 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: *** uWSGI is running in multiple interpreter mode *** May 26 12:46:39.917385 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: spawned uWSGI master process (pid: 124812) May 26 12:46:39.917597 dv-cinder-815146-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 12:46:39.919195 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: spawned uWSGI worker 1 (pid: 124830, cores: 1) May 26 12:46:39.919195 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: spawned uWSGI worker 2 (pid: 124831, cores: 1) May 26 12:46:39.919195 dv-cinder-815146-11-iscsi devstack@n-api.service[124812]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:46:41.178894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:46:41.179670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:46:41.996504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:46:41.996504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: from cryptography.utils import int_from_bytes May 26 12:46:41.996833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:46:41.996833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: from cryptography.utils import int_from_bytes May 26 12:46:42.008363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:46:42.008363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: from cryptography.utils import int_from_bytes May 26 12:46:42.008703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:46:42.008703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: from cryptography.utils import int_from_bytes May 26 12:46:44.554034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:46:44.554606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:46:44.554927 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:46:44.555148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:46:44.555418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:46:44.555817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.556154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.556500 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.556822 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.557167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.557491 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.557826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.558163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.558505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.558807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.559137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.559473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-11-iscsi {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.559804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.560161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.560445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.560779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.561122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.561556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.561894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.562411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.563882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.563882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.563882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.564277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.564545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.565107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.565503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.565844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.566173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.566492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.566946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-11-iscsi {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.567278 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.567603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.567937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.568374 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.568699 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.569022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.569382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.569706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.570010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.570349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.570712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.571049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.571383 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.571817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.572194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.572385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.572641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.572964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.573283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.573545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.573869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.574201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.574576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.574892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.575156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.575418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.575749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.576195 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.576511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.576826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.577146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.577465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.577783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.578104 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.578488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.578755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.579083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.579411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.579775 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.580068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.580921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.581341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.581606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.581924 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.582280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.582635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.582975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.583291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.583622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.583946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.584269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.584584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.586876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.586876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.586876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.586876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.586876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.586876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.586876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.587960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.587960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.587960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.587960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.588589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.588589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.588859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.589737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.589737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.590044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.590200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.590382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.590722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.591074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.591389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.591709 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.592029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.592345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.592662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.592995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.593316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.593480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:46:44.594017 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:46:44.594160 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.594160 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.594467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:46:44.594668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.594843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:46:44.594996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.595138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:46:44.595302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.595453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.595596 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.595778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.596509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.596667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.596819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.596969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.597497 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.597670 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.597820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.597978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.598134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.598281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.598423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.598644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.598789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.598943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.599084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.599260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.599417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.599573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.599716 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.599871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.600020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.600182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.600324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-11-iscsi {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.600473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.600627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.600777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.600924 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.601092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.601647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.601803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.601956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.602119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.602261 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.602401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.602579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.602741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.602999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.603158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.603158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.603595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.603595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.603906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.604051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.604199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.604342 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.604495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.604647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.604799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.604940 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.605082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.605235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.605386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.605536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.605686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.605834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.605975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.606117 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.606267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.606428 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.606603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.606758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-11-iscsi {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.606899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.606899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.607183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.607349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.607831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.607831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.608112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.608112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.608414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.608570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.608721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.608862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.609003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.609151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.609301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.609444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.609590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.609733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.609873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.610023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.610171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.610332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.610484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.610695 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.610849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.610849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.611133 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.611283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.611859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.612022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.612164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.612316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.612465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.612465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.612465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.613015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.613175 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.613343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.613661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.613816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.613816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.614092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.614242 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.614391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.614551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.614698 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.614852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.615018 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.615168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.615314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.615464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.615607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.615748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.615899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.616041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.616197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.616345 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.616492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.616642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.616792 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.616940 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.617090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.617239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.617381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.617533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.618039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.618190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.618332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.618473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.618677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.618829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.618992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.619141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.619289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.619437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.619585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.619737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.619879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.620021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.620161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.620301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.620449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.620606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.620749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.620907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.621049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.621190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.621337 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.621583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.622080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.622223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.622365 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.622505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.622681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.622835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.622985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.623181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.623328 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.623468 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.623791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.623943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.624084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.624224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.624377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.624525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.624675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.624816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.624967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.625115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.625268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.625409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.625559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.625710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.625899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.626058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.626207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.626365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.626515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.626694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.626844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.627009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.627165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.627327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.627327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.627327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.628210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.628210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.628210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.628210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.628805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.628955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.629098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.629098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.629364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.629364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.629650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.629799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.629948 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.630097 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.630239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.630380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.630554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.630702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.630855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.630997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.631146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.631295 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.631449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.631600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.631741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.632198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.632356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.632498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.632652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.632794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.632953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.633210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.633383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.633528 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.633677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.633989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.634170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.634318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.634460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.634635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.634788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.634944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.635133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.635133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.635411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.635411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.635688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.635830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.635990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.636187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.636343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.636486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.636649 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.636799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.636799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.637077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.637219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.637219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.637494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.637644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.637785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.637940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.637940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.638622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.638783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.638941 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.639084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.639226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.639375 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.639375 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.639652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.639802 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.639951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.640100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.640260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.640408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.640555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.640830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.640980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.641222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.641375 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.641590 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.641865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.642426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.642426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.643261 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.643404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.643569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.643792 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.644162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.644322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.644474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.644622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.644794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.645122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.645432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.645591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.645743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:46:44.645888 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.646072 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.647463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.647677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.647677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.649204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.649369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.649369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.650240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.650391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.650391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.652968 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.653141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.653141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.653445 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.653598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.653598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.653884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.654035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.654377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.654582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.654732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.654884 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.654884 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.655287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.655448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.655448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.655737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.655879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.656019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.656238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.656238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.656526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.656668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.656808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.656949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.656949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.657237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.657635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.657789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.657977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.658132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.658402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.659440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.659597 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.659740 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.659889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.660039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.660191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.660340 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.660483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.660633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.660792 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.660792 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.661088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.661231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.661374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.661515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.661664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.661818 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.661960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.662101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.662249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.662399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.662582 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.662777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.663328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.663471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.663620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.663764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.663905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.664062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.664214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.665116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.665271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.665422 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.665565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.665565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.665863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.666006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.666156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.666156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.666438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.666603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.666762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.666907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.667098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.667098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.667387 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.667532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.667692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.667692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.667977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.668126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.668276 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.668418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.668418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.668700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.668842 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.668984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.669156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.669156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.669689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.669851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.670026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.670026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.670424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.670619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.670778 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.670933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.670933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.671215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.671358 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.671506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.671648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.671789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.671948 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.672104 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.672254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.672396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.672537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.672685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.672834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.672834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.673541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.673700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.673901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.674061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.674220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.674395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.674751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.674902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.675043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.675200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.675354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.675505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.675505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.675787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.675929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.676110 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.676270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.676431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.676574 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.676728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.676877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.677019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.677460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.677609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.677754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.677913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.678064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.678214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.678358 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.678508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.678762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.678914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.679057 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.679206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.679355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.679761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.679918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.680074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.680217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.680366 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.680622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.680772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.680927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.681098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.681241 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.681382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.681531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.681672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.681826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.681968 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.682109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.682250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.682392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.682682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.683870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.684030 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.684030 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.684327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.684478 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.684621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.685235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.685406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.685560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.685706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.685847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.685989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.686131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.686293 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.686449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.686655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.686803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.686946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.687094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.687236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.687391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.687542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.687685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.687828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.687970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.688206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.688359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.688509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.688651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.688793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.688936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.689133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.689279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.689443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.690366 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.690520 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.690836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.690997 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.691153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.691304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.691452 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.691604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.691754 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.691905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.692055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.692198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.692347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.692488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.692638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.692787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.692936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.693097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.693240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.693390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.693561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.694132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.694282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.694434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.694610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.694757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.694911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.695062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.695410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.695560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.695720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.695864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.696025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.696168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.696168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.696438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.696586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.696743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.696886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.697026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.697174 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.697174 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.697696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.697862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.698005 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.698164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.698164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.698451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.698654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.698654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699345 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699345 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.699908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.700001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.700089 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.700191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.700528 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.700640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.700736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.700850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.700944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701110 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701391 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701571 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.701922 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702508 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.702935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703387 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703477 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703571 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.703861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704352 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704529 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.704955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.705050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.705231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706905 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.706991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707328 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.707871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.708115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.708410 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.708516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.708724 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.708874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.709058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.709243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.709409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.709586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.709725 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.709936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.710028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.710274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.710375 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.710695 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.710815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.710970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.711071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.711313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.711407 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.711654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.711747 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.711966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.712073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.712291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.712390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.712610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.712708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.712930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.713089 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.713247 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.713355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.713562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.713654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.713878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.713984 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.714196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.714299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.714515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.714626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.714850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.714956 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.715167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.715250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.715480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.715561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.715788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.715870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.716193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.716283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.716409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.716492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.716745 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.717040 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.717129 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.717383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.717465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.717724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.717814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.718046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.718136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.718375 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.718464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.718736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.718903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.719098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.719179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.719458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.719554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.719824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.719911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.720138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.720227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.720456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.720539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.720922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.721110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.721271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.721354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.721491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.721645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.721804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.721974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.722116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.722414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.722601 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.722794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.722895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.723124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.723229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.723451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.724584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.724584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.724754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.724826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.724904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.724989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.725069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.725141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.725274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.725357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.725593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.725763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.725928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.726012 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.726351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.726454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.726612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.726712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.726954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.727037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.727272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.727355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.727604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.727697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.729927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.730024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.730116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.730208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.730290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.730380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.730472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.730773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.731113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.731425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.731524 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.731994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.732120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.732319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.732411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.732728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.732830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.733058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.733186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.733384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.733526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.733701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.733816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.734019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.734144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.734335 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.734453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.734690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.734800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.735008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.735170 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.735329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.735489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.735645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.735801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.735969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.736126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.736280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.736482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.736582 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.736851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.737026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.737188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.737359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.737524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.737713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.737830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.738049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.738216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.738368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.738512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.738735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.738847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.739042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.739134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.739351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.739451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.739662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.739768 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.739977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.740069 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.740311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.740410 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.740635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.740753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.740974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.741090 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.741332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.741442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.741600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.741704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.741913 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.742025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.742222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.742317 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.742637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.742728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.742875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.742960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.743209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.743292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.743532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.743623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.743841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.743932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.744156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.744238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.744476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.744569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.744816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.744906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.745150 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.745239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.745461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.745552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.745772 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.745883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.746079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.746188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.746409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.746505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.746756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.746868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.747070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.747286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.747446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.747603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.747758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.747868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.748006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.748395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.748395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.748703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.748831 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.748946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.749049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.749172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.749322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.749449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.749776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.750005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.750386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.750609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.750988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.751117 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.751409 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.751723 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.751841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.752778 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.752911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.753108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.753213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.753439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.753726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.753836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.754040 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.754142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.754406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.754512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.754754 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.754848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.755061 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.755163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.755473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.755724 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.755892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.756056 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.756210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.756396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.756578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.756734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.756899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.757046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.757190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.757366 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.757518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.757704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.757880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.758070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.758227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.758510 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.758693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.758846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.758997 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.759144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.759271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.759438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.759588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.759780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.759925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.760109 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.760263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.760430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.760573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.760747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.761043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.761153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.761408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.761533 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.761907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.762134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.762300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.762408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.762750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.762880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.763183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.763302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.763392 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.763717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.763844 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.764110 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.764320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.764431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.764829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.764966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.765188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.765300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.765548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.765761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.766069 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.766212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.766436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.766610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.766807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.766941 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.767160 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.767299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.767538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.768448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.768811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.768993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.769145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.769378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.769481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.769786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.769895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.770121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.770270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.770483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.770759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.770864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.771191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.771314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.771515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.771841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.771962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.772171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.772494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.772649 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.772854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.773076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.773212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.773544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.773653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.773873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.773979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.774208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.774301 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.774571 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.774669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.774924 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.775036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.775286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.775515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.775609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.775983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.776134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.776481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.776604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.776834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.777076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.777201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.777442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.777557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.777840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.777941 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.778171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.778289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.778509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.778868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.778977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.779383 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.779505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.779714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.780079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.780185 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.780427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.780536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.780757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.781022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.781135 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.781401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.781607 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.781765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.782124 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.782241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.782834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.783025 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.783416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.783531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.783781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.783891 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.784149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.784243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.784492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.784592 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.784869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.785230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.785805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.785919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.785919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.786111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.786252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.786477 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.786684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.787066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.787229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.787334 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.788569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.788687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.788687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.788843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.788986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.789167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.789472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.789584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.789794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.790066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.790167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.790438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.790784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.790995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.791140 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.791346 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.791471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.791785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.792071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.792181 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.792386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.792621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.792730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.793008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.793214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.793364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.793671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.793983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.794160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.794342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.794657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.794763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.795007 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.795112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.795362 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.795512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.795646 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.795775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.796055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.796167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.796387 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.796518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.796722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.797071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.797195 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.797471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.797874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.798038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.798302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.798416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.798715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.798902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.799104 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.799320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.799471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.799683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.799800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.800395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.800741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.800946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.801075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.801426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.801528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.801768 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.801958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.802077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.802390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.802494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.802748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.802985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.803102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.803378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.803525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.803791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.804099 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.804210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.804371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.804660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.804766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.804997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.805099 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.805318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.805562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.805663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.805946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.806046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.806264 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.806481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.806651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.806940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.807064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.807230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.807506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.807622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.807719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.807900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.808088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.808233 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.808453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.808555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.808842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.808933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.809199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.809304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.809525 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.809660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.809863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.810016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.810250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.810363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.810593 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.810732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.810924 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.811228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.811332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.811610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.811755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.811932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.812093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.812377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.812485 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.812705 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.813034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.813135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.813368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.813679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.813787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.814010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.814157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.814342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.814516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.815238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.815685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.815841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.816107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.816233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.816356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.816451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.816708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.816833 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.817054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.817332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.817428 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.817693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.817836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.818146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.818269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.818438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.818696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.818808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.818931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.819113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.819438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.819518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.819758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.819997 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.820126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.820346 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.820470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.820688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.820803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.821004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.821107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.821318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.821420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.821633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.821742 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.821955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.822059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.822269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.822363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.822607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.822920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.823024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.823231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.823336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.823547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.823731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.823927 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.824123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.824227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.824471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.824581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.824851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.824949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.825083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.825193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.825399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.825551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.825727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.825974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.826098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.826400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.826594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.826755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.826915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.827059 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.827374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.827544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.827729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.827896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.828045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.828216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.828367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.828506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.828665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.828821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.828977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.829135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.829265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.829418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.829603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.829793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.829933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.830100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.830256 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.830608 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.830806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.830976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.831141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.831301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.831457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.831611 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.831771 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.831928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.832122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.832263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.832473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.832618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.832775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.832930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.833109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.833270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.833429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.833597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.833764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.833916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.834055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.834237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.834389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.834638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.834806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.834920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.835018 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.835289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.835398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.835622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.835738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.835955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.836050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.836283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.836398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.836611 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.836713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.836949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.837052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.837292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.837434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.837616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.837763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.837954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.838103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.838289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.838457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.838655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.838806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.838959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.839115 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.839280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.839425 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.839621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.839774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.839946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.840106 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.840269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.840408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.840740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.840882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:46:44.841155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.841486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.841831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.842332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.842809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.843206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.843538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.843923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.844240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.844555 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.844869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.845202 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.845518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.846404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.846755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.847072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.847616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.847967 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.848646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.848923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.849276 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.849717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.850064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.850392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.850738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.851080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.851439 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.851769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.852093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.852414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.852744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.853039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.853355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.853758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.854094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.854453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.855116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.855502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.855883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.856227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.856538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.856857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.857197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.857527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.857867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.858195 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.858514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.858876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.859229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.859540 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.859880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.860193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.860510 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.860884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.861214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.862287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.862707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.863064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.863402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.863752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.864078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.864395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.864774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.865187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.865768 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.866115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.866487 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.866882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.867231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.867580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.867893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.868210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.868541 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.868860 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.869175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.869493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.869845 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.870188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.870702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.870865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.871253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.871572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.871888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.872204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.872518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.872854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.873179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.873540 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.873870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.874196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.874543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.874935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.875251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.875567 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.875915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.876229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.876553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.876889 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.877753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.878292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.879133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.879784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.880315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.880902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.881244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.881606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.882072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.882589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.882934 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.883321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.883701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.884215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.884825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.885423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.885852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.886180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.886505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.886878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.887216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.887546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.887961 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.888253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.888564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.888950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.889266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.889702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.889892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.890214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.890558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.890863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.891171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.891483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.891794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.892128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.892458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.892857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.893172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.893484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.894194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.894516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.894884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.895225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.895577 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.895912 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.896231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.896561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.896882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.897210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.897553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.897879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.898215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.898641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.898918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.899255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.899573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.899894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.900211 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.900545 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.900905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.901241 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.901555 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.902265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.902630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.902963 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.903129 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Registered counter for database nova_api May 26 12:46:44.903279 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.903595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.903974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.904300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.904618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.904940 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.905280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.905632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.905960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.906285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.906637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.906975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.907565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.908189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.909292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.909705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.910024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.910393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.910756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.911084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.911407 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.911721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:46:44.911974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:46:44.924739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:46:44.932453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:46:44.974494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Registered counter for database nova_api May 26 12:46:44.991796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.context [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e72b17b-274a-4fb6-89bb-8004b3c5f49b(cell1) {{(pid=124830) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:46:44.994759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:46:44.996339 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:44.997970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:44.998845 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.000888 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.003031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:46:45.003997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Registered counter for database nova_cell0 May 26 12:46:45.009994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Registered counter for database nova_cell1 May 26 12:46:45.018561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:46:45.019892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:46:45.026656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:46:45.028288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:46:45.063032 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.context [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e72b17b-274a-4fb6-89bb-8004b3c5f49b(cell1) {{(pid=124831) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:46:45.067851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.069535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.070397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.072479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.076543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Registered counter for database nova_cell0 May 26 12:46:45.078783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Registered counter for database nova_cell1 May 26 12:46:45.086403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:46:45.087993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:46:45.095706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:46:45.098545 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:46:45.178801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Registered counter for database nova_cell0 May 26 12:46:45.185732 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:46:45.190938 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:46:45.255305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Registered counter for database nova_cell0 May 26 12:46:45.266951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:46:45.271795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:46:45.516817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:46:45.524619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:46:45.617548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:46:45.626477 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:46:45.876410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:46:45.882937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-800b4ab8-fd0d-44d5-a0f6-c70a4064944d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:46:45.888235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646e2d579c0 pid: 124830 (default app) May 26 12:46:46.016627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:46:46.028693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-715c77f9-676a-4c36-89c0-11ada1b21b52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:46:46.037404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5646e2d579c0 pid: 124831 (default app) May 26 12:47:31.002400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.003318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.004145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.005334 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:32.627277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-722df12a-a02c-46fa-adb0-fef28395a6b0 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Action: 'create', calling method: .version_select at 0x7f498d22fc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1477556504"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:35.249062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-722df12a-a02c-46fa-adb0-fef28395a6b0 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.251735 May 26 12:47:35.250886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1154 bytes} [Thu May 26 12:47:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4255 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 12:47:35.565502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9499d4ef-f8af-420e-86a5-22c443b82682 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498d2e5790>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:35.609389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:35.610461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:35.612970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:35.615193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:35.984666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-615497346", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "networks": [{"uuid": "79e16efc-826e-49d9-b497-7141a9500ea6"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:36.198114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] validate_networks() for [('79e16efc-826e-49d9-b497-7141a9500ea6', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:47:36.280236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9499d4ef-f8af-420e-86a5-22c443b82682 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 200 len: 345 microversion: 2.1 time: 1.019047 May 26 12:47:36.284042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1/2] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:35 2022] GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 345 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:36.509669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df760de1-10d4-4099-b598-80c43aee7026 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498d0b9e50>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:36.653048 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df760de1-10d4-4099-b598-80c43aee7026 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9229d05e-170a-429c-b92c-e0552dedaea6" status: 200 len: 351 microversion: 2.1 time: 0.148551 May 26 12:47:36.654392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:36 2022] GET /compute/v2.1/os-volumes/9229d05e-170a-429c-b92c-e0552dedaea6 => generated 351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:37.296588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-214c4fc7-c93b-41fb-bb05-a9d809493d9b tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498d0820d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:37.525678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:47:37.526202 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:47:37.526758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:47:37.527303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:47:37.527795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:47:37.562562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:37.564650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:37.565850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:37.567330 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:37.628207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Getting quotas for project 20b96e086a2544f6863deb39403e425c. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:47:37.645621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Getting quotas for user 6b148a9fa622488197fc684ccb665e1b and project 20b96e086a2544f6863deb39403e425c. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:47:37.681386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:47:37.691491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-214c4fc7-c93b-41fb-bb05-a9d809493d9b tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 200 len: 346 microversion: 2.1 time: 0.398888 May 26 12:47:37.693675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:37 2022] GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 346 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:37.699063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:47:37.703840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dfc73f63-e291-4217-a8c9-ad09d214ded0 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Action: 'create', calling method: .version_select at 0x7f498d082670>, body: {"snapshot": {"volume_id": "d8c8f197-f10a-4411-9a11-b1f324bfc3e4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2039915664"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:37.947761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9aa985d-0a36-4ea7-b1d2-9ee788f792af tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.300447 May 26 12:47:37.949411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2/5] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:47:37.986640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19768efb-68a4-47e2-8d8a-a5ecdf2cc860 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:37.988470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19768efb-68a4-47e2-8d8a-a5ecdf2cc860 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:38.212437 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19768efb-68a4-47e2-8d8a-a5ecdf2cc860 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:38.231756 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19768efb-68a4-47e2-8d8a-a5ecdf2cc860 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1214 microversion: 2.1 time: 0.275817 May 26 12:47:38.240180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:37 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:38.712432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dfc73f63-e291-4217-a8c9-ad09d214ded0 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.012588 May 26 12:47:38.713455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 4/7] 10.222.0.60 () {60 vars in 1161 bytes} [Thu May 26 12:47:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:38.723913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-83c3709c-854f-4be0-be74-27f4b1490296 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c73ba60>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:38.909298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-83c3709c-854f-4be0-be74-27f4b1490296 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.190060 May 26 12:47:38.910388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:38 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:38.927240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44fdb4f2-432b-419c-a816-fa84bdc72476 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498d094160>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:39.257618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8235554a-a8fa-412f-ad9e-def1f5152630 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:39.258255 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8235554a-a8fa-412f-ad9e-def1f5152630 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:39.265922 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44fdb4f2-432b-419c-a816-fa84bdc72476 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.344311 May 26 12:47:39.266497 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 5/9] 10.222.0.60 () {58 vars in 1139 bytes} [Thu May 26 12:47:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:39.278202 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-582b2a3e-ca57-4332-b59e-8a2522f7ce90 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498d0b9c10>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:39.566265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8235554a-a8fa-412f-ad9e-def1f5152630 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:39.575339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-582b2a3e-ca57-4332-b59e-8a2522f7ce90 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.295472 May 26 12:47:39.575339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 6/10] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:39 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:39.576919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8235554a-a8fa-412f-ad9e-def1f5152630 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1214 microversion: 2.1 time: 0.324013 May 26 12:47:39.577838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 5/11] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:39 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1214 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:40.116051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d629c780-87d5-4937-8eb1-7d382582eebd tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498d094430>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:40.219999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d629c780-87d5-4937-8eb1-7d382582eebd tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2605c0b8-d6e1-4e8e-8125-0b982349064e" status: 200 len: 350 microversion: 2.1 time: 0.108437 May 26 12:47:40.226928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 7/12] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:40 2022] GET /compute/v2.1/os-volumes/2605c0b8-d6e1-4e8e-8125-0b982349064e => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:40.588690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-022e639a-8f82-474b-b0fe-bd7c54e178c3 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c74bee0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:40.602460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56719403-8dd7-4c5f-a51b-58c3f329ade5 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:40.603643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56719403-8dd7-4c5f-a51b-58c3f329ade5 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:40.737033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56719403-8dd7-4c5f-a51b-58c3f329ade5 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:40.820127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56719403-8dd7-4c5f-a51b-58c3f329ade5 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1214 microversion: 2.1 time: 0.220595 May 26 12:47:40.821173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:40 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:40.955547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-022e639a-8f82-474b-b0fe-bd7c54e178c3 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.375870 May 26 12:47:40.957035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 6/14] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:40 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:41.851350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93b03369-c354-4d0e-bbbe-59d701887c16 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:41.852650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93b03369-c354-4d0e-bbbe-59d701887c16 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:41.886017 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93b03369-c354-4d0e-bbbe-59d701887c16 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:41.888180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93b03369-c354-4d0e-bbbe-59d701887c16 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:41.891547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93b03369-c354-4d0e-bbbe-59d701887c16 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:41.896985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93b03369-c354-4d0e-bbbe-59d701887c16 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:41.969674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c818cd5b-42fb-4527-85b3-5b62d710f9ba tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c73b700>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:42.033267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c818cd5b-42fb-4527-85b3-5b62d710f9ba tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.067596 May 26 12:47:42.038503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 7/15] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:41 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:42.293978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93b03369-c354-4d0e-bbbe-59d701887c16 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:42.319795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93b03369-c354-4d0e-bbbe-59d701887c16 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1218 microversion: 2.1 time: 0.480913 May 26 12:47:42.320875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 9/16] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:41 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1218 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:43.054719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a59d62bb-cde0-4187-9752-44096c1d8a78 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c75c9d0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:43.129002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a59d62bb-cde0-4187-9752-44096c1d8a78 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.086095 May 26 12:47:43.129822 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 8/17] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:43 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:43.339513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dfe9275d-bad1-4855-85df-4dfe9dcb1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:43.340487 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dfe9275d-bad1-4855-85df-4dfe9dcb1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:43.353596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfe9275d-bad1-4855-85df-4dfe9dcb1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:43.354287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfe9275d-bad1-4855-85df-4dfe9dcb1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:43.355277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfe9275d-bad1-4855-85df-4dfe9dcb1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:43.356097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfe9275d-bad1-4855-85df-4dfe9dcb1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:43.511743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dfe9275d-bad1-4855-85df-4dfe9dcb1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:43.521498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dfe9275d-bad1-4855-85df-4dfe9dcb1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1218 microversion: 2.1 time: 0.187091 May 26 12:47:43.522121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 10/18] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:43 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:43.840649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-346c17ef-b584-47ae-84e8-c45c85e1fdfd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: .version_select at 0x7f498c73b940>, body: {"keypair": {"name": "tempest-keypair-1155804079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ1kBGoSJhpHqyxOCgkfFicier0UjOPJ/iIkEezSlLIJAA1m274e4gMPq30FNa+U1tYd/tE3VbgEKVHIRbFkaPpZ1apGjMHWz6S+VijxEzQdtvtKn/s51vMWInSp2gVJA=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:43.870910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-346c17ef-b584-47ae-84e8-c45c85e1fdfd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:47:43.877359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-346c17ef-b584-47ae-84e8-c45c85e1fdfd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for user 98a275f65a3544a5b073fbf1ee10034b and project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:47:44.017132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-346c17ef-b584-47ae-84e8-c45c85e1fdfd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.387723 May 26 12:47:44.020555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 9/19] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 12:47:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:44.052706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1635987558", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:44.143934 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef067ff6-69a3-45ac-829e-f46bca9a43ee tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c773040>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:44.189836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] validate_networks() for [('76e35e60-6dcf-460f-9f24-e35550b81f28', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:47:44.203051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef067ff6-69a3-45ac-829e-f46bca9a43ee tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.063672 May 26 12:47:44.203904 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 10/20] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:44 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:44.541108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce73b878-1635-4971-a2e6-e64baf9222cc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:44.541852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce73b878-1635-4971-a2e6-e64baf9222cc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:44.571487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce73b878-1635-4971-a2e6-e64baf9222cc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:44.577356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce73b878-1635-4971-a2e6-e64baf9222cc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:44.584616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce73b878-1635-4971-a2e6-e64baf9222cc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:44.585187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce73b878-1635-4971-a2e6-e64baf9222cc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:44.769239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce73b878-1635-4971-a2e6-e64baf9222cc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:44.783153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce73b878-1635-4971-a2e6-e64baf9222cc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1210 microversion: 2.1 time: 0.246596 May 26 12:47:44.790503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 11/21] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:44 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1210 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:45.218781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b975fe3-c9b8-4cbf-8f55-973c9d475388 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c773310>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:45.257611 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b975fe3-c9b8-4cbf-8f55-973c9d475388 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.046323 May 26 12:47:45.262335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 12/22] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:45 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:45.440528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:47:45.441495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:47:45.442221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:47:45.443074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:47:45.449735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:47:45.460989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.461658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.462703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.463397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.508366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Getting quotas for project 98c0c747833441bda0a5f8d62de53cd3. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:47:45.516846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Getting quotas for user e24e8e8d0b8042bfb7ee7881aa8a16c1 and project 98c0c747833441bda0a5f8d62de53cd3. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:47:45.530892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:47:45.538141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:47:45.752854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-703a4064-1a85-4c34-9e17-11c797431434 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.795445 May 26 12:47:45.753688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 11/23] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:47:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:47:45.772988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-891aeb2e-5b95-4e4c-890b-d65222ab94d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:45.773868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-891aeb2e-5b95-4e4c-890b-d65222ab94d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:45.806878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-553025b6-0521-498c-9670-c441487c5c7b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:45.807623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-553025b6-0521-498c-9670-c441487c5c7b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:45.837776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-553025b6-0521-498c-9670-c441487c5c7b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.838426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-553025b6-0521-498c-9670-c441487c5c7b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.839949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-553025b6-0521-498c-9670-c441487c5c7b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.840619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-553025b6-0521-498c-9670-c441487c5c7b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.911012 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-891aeb2e-5b95-4e4c-890b-d65222ab94d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:45.921390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-891aeb2e-5b95-4e4c-890b-d65222ab94d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1222 microversion: 2.1 time: 0.159295 May 26 12:47:45.922601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 13/24] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:45 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:45.977537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-553025b6-0521-498c-9670-c441487c5c7b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:46.006698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-553025b6-0521-498c-9670-c441487c5c7b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1266 microversion: 2.1 time: 0.204129 May 26 12:47:46.011825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 12/25] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:45 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:46.036559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-666070317", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:46.111132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] validate_networks() for [('76e35e60-6dcf-460f-9f24-e35550b81f28', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:47:46.284522 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-608f3775-0c78-48a0-923a-f1d5f130c510 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c698af0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:46.352626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-608f3775-0c78-48a0-923a-f1d5f130c510 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.086376 May 26 12:47:46.353793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 13/26] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:46 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:47.027758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f3a0e153-dc0e-44a1-93a1-f5d3a1ad1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:47.028657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f3a0e153-dc0e-44a1-93a1-f5d3a1ad1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:47.054964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3a0e153-dc0e-44a1-93a1-f5d3a1ad1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.055767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3a0e153-dc0e-44a1-93a1-f5d3a1ad1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.056835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3a0e153-dc0e-44a1-93a1-f5d3a1ad1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.057978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3a0e153-dc0e-44a1-93a1-f5d3a1ad1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.071151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:47:47.071707 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:47:47.072801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:47:47.073411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:47:47.074106 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:47:47.119276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.119276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.119276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.119276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.170059 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Getting quotas for project 98c0c747833441bda0a5f8d62de53cd3. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:47:47.190355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Getting quotas for user e24e8e8d0b8042bfb7ee7881aa8a16c1 and project 98c0c747833441bda0a5f8d62de53cd3. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:47:47.234801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:47:47.245147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f3a0e153-dc0e-44a1-93a1-f5d3a1ad1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:47.249240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:47:47.256302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f3a0e153-dc0e-44a1-93a1-f5d3a1ad1a21 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1284 microversion: 2.1 time: 0.233238 May 26 12:47:47.257540 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 14/27] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:47 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:47.367633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c911f288-7d9f-452b-b87a-c0d90581a174 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498d094b80>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:47.444366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c911f288-7d9f-452b-b87a-c0d90581a174 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 288 microversion: 2.1 time: 0.081259 May 26 12:47:47.445889 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 15/28] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:47 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:47.462909 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6b745833-f7dd-4b98-8574-e1db9e04e554 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c6980d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:47.479691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a949d95-832e-42a8-ad1d-8a1dda4da996 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.448801 May 26 12:47:47.481655 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 14/29] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:47:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:47:47.506118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-586a9d29-9fbe-419c-a6be-46bc8205feee tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:47.509745 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-586a9d29-9fbe-419c-a6be-46bc8205feee tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:47.624641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-586a9d29-9fbe-419c-a6be-46bc8205feee tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:47.633815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-586a9d29-9fbe-419c-a6be-46bc8205feee tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1221 microversion: 2.1 time: 0.143848 May 26 12:47:47.634418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 15/30] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:47 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:47.668200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6b745833-f7dd-4b98-8574-e1db9e04e554 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 202 len: 0 microversion: 2.1 time: 0.215571 May 26 12:47:47.672529 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 16/31] 10.222.0.60 () {58 vars in 1253 bytes} [Thu May 26 12:47:47 2022] DELETE /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:47:47.679318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-80fb193e-797c-4838-b0d5-c684d5cbfd4b tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c6ed310>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:47.772554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-80fb193e-797c-4838-b0d5-c684d5cbfd4b tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 200 len: 287 microversion: 2.1 time: 0.098608 May 26 12:47:47.774613 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 16/32] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:47 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:48.118437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-102b14c0-0f26-4631-975b-4b299fad8a87 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498c69c5e0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:48.275134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c691f7ba-bef5-4377-81e3-2bc98dfdb8ee tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:48.278924 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c691f7ba-bef5-4377-81e3-2bc98dfdb8ee tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:48.291366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-102b14c0-0f26-4631-975b-4b299fad8a87 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8432b19-5ca6-4baa-ae14-5510701d0241" status: 200 len: 350 microversion: 2.1 time: 0.176493 May 26 12:47:48.298688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 17/33] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:48 2022] GET /compute/v2.1/os-volumes/d8432b19-5ca6-4baa-ae14-5510701d0241 => generated 350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:48.311730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c691f7ba-bef5-4377-81e3-2bc98dfdb8ee tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:48.312501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c691f7ba-bef5-4377-81e3-2bc98dfdb8ee tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:48.314025 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7661134e-d02c-4b1b-8be3-3c985ce763fd tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498d0b98b0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:48.326274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c691f7ba-bef5-4377-81e3-2bc98dfdb8ee tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:48.327337 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c691f7ba-bef5-4377-81e3-2bc98dfdb8ee tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:48.536903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c691f7ba-bef5-4377-81e3-2bc98dfdb8ee tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:48.551577 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c691f7ba-bef5-4377-81e3-2bc98dfdb8ee tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1272 microversion: 2.1 time: 0.280941 May 26 12:47:48.553209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 17/34] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:48 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:48.652515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c9a83e3-4db2-4616-8d84-c38dca9fd2e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:48.653418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c9a83e3-4db2-4616-8d84-c38dca9fd2e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:48.809560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7661134e-d02c-4b1b-8be3-3c985ce763fd tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.508745 May 26 12:47:48.810156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 18/35] 10.222.0.60 () {58 vars in 1133 bytes} [Thu May 26 12:47:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:48.831384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f85f3ee-4737-427c-91e0-4ab1c4f2ae03 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c68bb80>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:49.014860 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-0f85f3ee-4737-427c-91e0-4ab1c4f2ae03 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] HTTP exception thrown: Snapshot 0a57ad59-4a99-4c18-bfba-e38274f76223 could not be found. May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f85f3ee-4737-427c-91e0-4ab1c4f2ae03 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Request method failure captured: May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 HTTP/1.1 May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bi7fEIcKDawGHcsmwrGQlVw4ugZt7vO1VBIaUZ8pRNOKBUUpLCmPdj5min2Iq7erEZEsV2ugkZcj697TDoQZr3HQJEp_hzBTfxm7ee3tqdlVaX5Lq08HYVGCd10YVuj4tryWQ6w2Uneurn7JJsyysH9PDV880cVKgqHGa1e9DUtr0 May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 87a842d33e6043a99b1cfa595a06c723 May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:47:49.020316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 87a842d33e6043a99b1cfa595a06c723 May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotsTestJSON-498106555-project May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 3a709d15f5534cf398c2ead09627b09c May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-498106555-project May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Snapshot 0a57ad59-4a99-4c18-bfba-e38274f76223 could not be found. May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '0a57ad59-4a99-4c18-bfba-e38274f76223'} May 26 12:47:49.021732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0a57ad59-4a99-4c18-bfba-e38274f76223 could not be found. (HTTP 404) (Request-ID: req-13b9d1bf-4e35-4bd2-9817-0bd591fe3e50) May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:49.022402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:47:49.023364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0a57ad59-4a99-4c18-bfba-e38274f76223 could not be found. May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 12:47:49.024244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0a57ad59-4a99-4c18-bfba-e38274f76223 could not be found. May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0a57ad59-4a99-4c18-bfba-e38274f76223 could not be found. May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f85f3ee-4737-427c-91e0-4ab1c4f2ae03 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Returning 404 to user: Snapshot 0a57ad59-4a99-4c18-bfba-e38274f76223 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:49.025190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f85f3ee-4737-427c-91e0-4ab1c4f2ae03 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223" status: 404 len: 111 microversion: 2.1 time: 0.208647 May 26 12:47:49.028247 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 19/36] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 26 12:47:48 2022] GET /compute/v2.1/os-snapshots/0a57ad59-4a99-4c18-bfba-e38274f76223 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:49.046849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-688c46f0-aa55-4473-9b7d-1b4e7cf7ed62 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498c69c280>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:49.245249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-688c46f0-aa55-4473-9b7d-1b4e7cf7ed62 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.215650 May 26 12:47:49.246205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 20/37] 10.222.0.60 () {58 vars in 1148 bytes} [Thu May 26 12:47:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:49.251669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01e191b8-8120-4262-a646-340a59c95847 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c6350d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:49.293973 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c9a83e3-4db2-4616-8d84-c38dca9fd2e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:49.305958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c9a83e3-4db2-4616-8d84-c38dca9fd2e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1221 microversion: 2.1 time: 0.657969 May 26 12:47:49.317586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 18/38] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:48 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1221 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:49.342779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-102ad471-1ac7-4558-856f-895326781e88 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498c6aeca0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:49.632305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01e191b8-8120-4262-a646-340a59c95847 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 202 len: 0 microversion: 2.1 time: 0.384608 May 26 12:47:49.632891 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 21/39] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 12:47:49 2022] DELETE /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:47:49.638374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-703616412", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6687087-b2c6-4c92-a8ec-55292a7bb20d"}], "security_groups": [{"name": "tempest-securitygroup--648044943"}], "key_name": "tempest-keypair-1155804079", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:49.867405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] validate_networks() for [('f6687087-b2c6-4c92-a8ec-55292a7bb20d', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:47:49.876861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-102ad471-1ac7-4558-856f-895326781e88 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.557774 May 26 12:47:49.885990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 19/40] 10.222.0.60 () {58 vars in 1133 bytes} [Thu May 26 12:47:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:49.893561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-26cd64ff-72f7-4762-9dc3-af9c60c0a6ea tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:49.903563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-26cd64ff-72f7-4762-9dc3-af9c60c0a6ea tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:49.922136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26cd64ff-72f7-4762-9dc3-af9c60c0a6ea tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:49.925691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26cd64ff-72f7-4762-9dc3-af9c60c0a6ea tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:49.933706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26cd64ff-72f7-4762-9dc3-af9c60c0a6ea tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:49.934294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26cd64ff-72f7-4762-9dc3-af9c60c0a6ea tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:50.468841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-26cd64ff-72f7-4762-9dc3-af9c60c0a6ea tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:50.468841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-26cd64ff-72f7-4762-9dc3-af9c60c0a6ea tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.534403 May 26 12:47:50.468841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 20/41] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:49 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:50.468841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-58f25b12-7f1c-4ebc-99b3-7433b7fb5f72 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c676e50>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:50.679137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:47:50.679137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:47:50.679137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:47:50.679137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:47:50.679137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:47:50.680443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:50.680443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:50.680443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:50.680443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:50.680790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:47:50.680790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for user 98a275f65a3544a5b073fbf1ee10034b and project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:47:50.680790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:47:50.680790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:47:51.006235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1403c544-da86-44c3-a593-c7e2c29ab45b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.372126 May 26 12:47:51.007307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:47:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:47:51.012320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2a2b6876-4e6e-4680-9be5-6dab5724adc1 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498c635d30>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.183800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-58f25b12-7f1c-4ebc-99b3-7433b7fb5f72 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 200 len: 345 microversion: 2.1 time: 0.760101 May 26 12:47:51.184807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 21/43] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:50 2022] GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 345 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:51.198008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0cbb05a5-c07f-43b1-8414-ac1bb62d95c0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.198672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0cbb05a5-c07f-43b1-8414-ac1bb62d95c0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:51.221373 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cbb05a5-c07f-43b1-8414-ac1bb62d95c0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.221774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cbb05a5-c07f-43b1-8414-ac1bb62d95c0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.222598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cbb05a5-c07f-43b1-8414-ac1bb62d95c0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.223048 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cbb05a5-c07f-43b1-8414-ac1bb62d95c0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.274311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2a2b6876-4e6e-4680-9be5-6dab5724adc1 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.265689 May 26 12:47:51.275178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 23/44] 10.222.0.60 () {58 vars in 1166 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:51.281610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50989eaa-b095-460c-ab60-8386fad9d052 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.282245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50989eaa-b095-460c-ab60-8386fad9d052 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:51.314904 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0cbb05a5-c07f-43b1-8414-ac1bb62d95c0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:51.326435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0cbb05a5-c07f-43b1-8414-ac1bb62d95c0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.140440 May 26 12:47:51.327945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 22/45] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:51.354361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-51f37ace-fe1e-4200-86a5-8143cc536583 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498c773280>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.478072 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-51f37ace-fe1e-4200-86a5-8143cc536583 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.148783 May 26 12:47:51.479452 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 23/46] 10.222.0.60 () {58 vars in 1169 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:51.485386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d77a0ff-4fc8-44ee-9c77-4e76befe1365 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.486490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d77a0ff-4fc8-44ee-9c77-4e76befe1365 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:51.496010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d77a0ff-4fc8-44ee-9c77-4e76befe1365 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.496895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d77a0ff-4fc8-44ee-9c77-4e76befe1365 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.498086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d77a0ff-4fc8-44ee-9c77-4e76befe1365 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.498820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d77a0ff-4fc8-44ee-9c77-4e76befe1365 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.547807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50989eaa-b095-460c-ab60-8386fad9d052 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:51.558087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50989eaa-b095-460c-ab60-8386fad9d052 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1241 microversion: 2.1 time: 0.281893 May 26 12:47:51.577530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 24/47] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1241 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:51.577530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f008738a-8dab-4b91-9a05-fee5eb0177ad tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498c5b9160>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.715254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f008738a-8dab-4b91-9a05-fee5eb0177ad tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.143388 May 26 12:47:51.716109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1154 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:51.730027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c148aaf5-cde8-4ae2-bebf-f58699ccbd81 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498c5dc5e0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.770963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d77a0ff-4fc8-44ee-9c77-4e76befe1365 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:51.791345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d77a0ff-4fc8-44ee-9c77-4e76befe1365 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.310575 May 26 12:47:51.800320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 24/49] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:51.833631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c148aaf5-cde8-4ae2-bebf-f58699ccbd81 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.109134 May 26 12:47:51.840668 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 26/50] 10.222.0.60 () {58 vars in 1187 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:51.851336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d341dffd-ba2f-4096-b663-0ba49b3663c6 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] Calling method '.version_select at 0x7f498c676430>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.950749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d341dffd-ba2f-4096-b663-0ba49b3663c6 tempest-VolumesTestJSON-368758625 tempest-VolumesTestJSON-368758625-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.104788 May 26 12:47:51.950749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 25/51] 10.222.0.60 () {58 vars in 1154 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:52.197872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31f87c00-4e3d-4a75-999b-fc6ebf53a464 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c5b90d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:52.309322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31f87c00-4e3d-4a75-999b-fc6ebf53a464 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 200 len: 345 microversion: 2.1 time: 0.115754 May 26 12:47:52.309962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 27/52] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:52 2022] GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:52.344026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbfbb3bc-d0cd-406d-841d-6a2318541b36 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:52.344670 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbfbb3bc-d0cd-406d-841d-6a2318541b36 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:52.351827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbfbb3bc-d0cd-406d-841d-6a2318541b36 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.352469 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbfbb3bc-d0cd-406d-841d-6a2318541b36 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.353424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbfbb3bc-d0cd-406d-841d-6a2318541b36 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.354007 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbfbb3bc-d0cd-406d-841d-6a2318541b36 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.435188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbfbb3bc-d0cd-406d-841d-6a2318541b36 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:52.443976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbfbb3bc-d0cd-406d-841d-6a2318541b36 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.103670 May 26 12:47:52.444791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 26/53] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:52 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:52.576660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3f6f2ee9-f46f-43ab-b0e4-71c60c551eef tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:52.577285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3f6f2ee9-f46f-43ab-b0e4-71c60c551eef tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:52.585858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f6f2ee9-f46f-43ab-b0e4-71c60c551eef tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.586233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f6f2ee9-f46f-43ab-b0e4-71c60c551eef tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.587252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f6f2ee9-f46f-43ab-b0e4-71c60c551eef tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.587703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f6f2ee9-f46f-43ab-b0e4-71c60c551eef tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.672066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3f6f2ee9-f46f-43ab-b0e4-71c60c551eef tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:52.686858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3f6f2ee9-f46f-43ab-b0e4-71c60c551eef tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1245 microversion: 2.1 time: 0.113869 May 26 12:47:52.687680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 28/54] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:52 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:52.814701 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9241ed1f-1945-44b3-85a5-1a2b3184be20 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:52.815463 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9241ed1f-1945-44b3-85a5-1a2b3184be20 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:52.822359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9241ed1f-1945-44b3-85a5-1a2b3184be20 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.822862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9241ed1f-1945-44b3-85a5-1a2b3184be20 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.823641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9241ed1f-1945-44b3-85a5-1a2b3184be20 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.824085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9241ed1f-1945-44b3-85a5-1a2b3184be20 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.957542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9241ed1f-1945-44b3-85a5-1a2b3184be20 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:52.965458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9241ed1f-1945-44b3-85a5-1a2b3184be20 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.154738 May 26 12:47:52.966041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 27/55] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:52 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:53.322110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6bb53d2f-7552-4d12-83eb-a78855143f65 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c5b9310>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:53.370915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6bb53d2f-7552-4d12-83eb-a78855143f65 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 200 len: 345 microversion: 2.1 time: 0.052527 May 26 12:47:53.371515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 29/56] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:53 2022] GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:53.461921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ace3a524-948f-4d30-af64-dc892d742c0b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:53.462637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ace3a524-948f-4d30-af64-dc892d742c0b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:53.468791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ace3a524-948f-4d30-af64-dc892d742c0b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:53.469252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ace3a524-948f-4d30-af64-dc892d742c0b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.470040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ace3a524-948f-4d30-af64-dc892d742c0b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:53.470482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ace3a524-948f-4d30-af64-dc892d742c0b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.537717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ace3a524-948f-4d30-af64-dc892d742c0b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:53.545566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ace3a524-948f-4d30-af64-dc892d742c0b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.088270 May 26 12:47:53.546151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 28/57] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:53 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:53.705060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a70eb38-4361-4300-a3a7-506be57ab1d8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:53.705786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a70eb38-4361-4300-a3a7-506be57ab1d8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:53.713455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a70eb38-4361-4300-a3a7-506be57ab1d8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:53.713939 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a70eb38-4361-4300-a3a7-506be57ab1d8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.714754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a70eb38-4361-4300-a3a7-506be57ab1d8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:53.715206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a70eb38-4361-4300-a3a7-506be57ab1d8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.787170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a70eb38-4361-4300-a3a7-506be57ab1d8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:53.794779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a70eb38-4361-4300-a3a7-506be57ab1d8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1245 microversion: 2.1 time: 0.093425 May 26 12:47:53.795357 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 30/58] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:53 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:53.983785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0fa4fe91-c6a8-4307-9653-c8953574bba6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:54.002690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0fa4fe91-c6a8-4307-9653-c8953574bba6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:54.002690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fa4fe91-c6a8-4307-9653-c8953574bba6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.002690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fa4fe91-c6a8-4307-9653-c8953574bba6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.002690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fa4fe91-c6a8-4307-9653-c8953574bba6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.003097 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fa4fe91-c6a8-4307-9653-c8953574bba6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.160594 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fa4fe91-c6a8-4307-9653-c8953574bba6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:54.169199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0fa4fe91-c6a8-4307-9653-c8953574bba6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.190097 May 26 12:47:54.169884 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 29/59] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:53 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:54.403898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2d49e32-d512-408e-94e3-e2e9ed85a840 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c5b94c0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:54.437420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2d49e32-d512-408e-94e3-e2e9ed85a840 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 200 len: 345 microversion: 2.1 time: 0.057898 May 26 12:47:54.438197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 31/60] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:54 2022] GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:54.562544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2e4283a-dcab-44d8-92f6-b88e67bdb076 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:54.563392 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2e4283a-dcab-44d8-92f6-b88e67bdb076 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:54.570404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2e4283a-dcab-44d8-92f6-b88e67bdb076 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.574211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2e4283a-dcab-44d8-92f6-b88e67bdb076 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.574211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2e4283a-dcab-44d8-92f6-b88e67bdb076 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.574211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2e4283a-dcab-44d8-92f6-b88e67bdb076 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.645681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2e4283a-dcab-44d8-92f6-b88e67bdb076 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:54.653528 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2e4283a-dcab-44d8-92f6-b88e67bdb076 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.094890 May 26 12:47:54.654351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 30/61] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:54 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:54.815504 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb078dc3-3b70-480a-a024-ab0e14187000 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:54.817051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb078dc3-3b70-480a-a024-ab0e14187000 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:54.825712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb078dc3-3b70-480a-a024-ab0e14187000 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.826928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb078dc3-3b70-480a-a024-ab0e14187000 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.828594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb078dc3-3b70-480a-a024-ab0e14187000 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.829299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb078dc3-3b70-480a-a024-ab0e14187000 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.910752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb078dc3-3b70-480a-a024-ab0e14187000 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:54.920307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb078dc3-3b70-480a-a024-ab0e14187000 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1245 microversion: 2.1 time: 0.110022 May 26 12:47:54.921058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 32/62] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:54 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:55.199758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7c4aa99-4581-4f61-ba84-9209f0fff831 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.200418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7c4aa99-4581-4f61-ba84-9209f0fff831 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:55.211453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7c4aa99-4581-4f61-ba84-9209f0fff831 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.212682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7c4aa99-4581-4f61-ba84-9209f0fff831 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.212898 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7c4aa99-4581-4f61-ba84-9209f0fff831 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.213297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7c4aa99-4581-4f61-ba84-9209f0fff831 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.425572 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7c4aa99-4581-4f61-ba84-9209f0fff831 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:55.434890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7c4aa99-4581-4f61-ba84-9209f0fff831 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.251144 May 26 12:47:55.438579 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 31/63] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:55 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:55.451459 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf326a3d-e884-40a0-a65e-8fc64ea28e64 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c5b9040>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.483795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-bf326a3d-e884-40a0-a65e-8fc64ea28e64 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] HTTP exception thrown: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf326a3d-e884-40a0-a65e-8fc64ea28e64 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Request method failure captured: May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 HTTP/1.1 May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bi7fEIcKDawGHcsmwrGQlVw4ugZt7vO1VBIaUZ8pRNOKBUUpLCmPdj5min2Iq7erEZEsV2ugkZcj697TDoQZr3HQJEp_hzBTfxm7ee3tqdlVaX5Lq08HYVGCd10YVuj4tryWQ6w2Uneurn7JJsyysH9PDV880cVKgqHGa1e9DUtr0 May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 87a842d33e6043a99b1cfa595a06c723 May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:47:55.486209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 87a842d33e6043a99b1cfa595a06c723 May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotsTestJSON-498106555-project May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 3a709d15f5534cf398c2ead09627b09c May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-498106555-project May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'd8c8f197-f10a-4411-9a11-b1f324bfc3e4'} May 26 12:47:55.487594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. (HTTP 404) (Request-ID: req-b8f3ce2f-04ff-4025-bb90-872f799ef215) May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.488434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:47:55.489759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:47:55.490956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf326a3d-e884-40a0-a65e-8fc64ea28e64 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Returning 404 to user: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:55.492457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf326a3d-e884-40a0-a65e-8fc64ea28e64 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 404 len: 109 microversion: 2.1 time: 0.040073 May 26 12:47:55.502765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af6e9591-75a8-4de5-a863-986e5b089dd8 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498c69bee0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.503639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 33/64] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:55 2022] GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:55.571810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-af6e9591-75a8-4de5-a863-986e5b089dd8 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] HTTP exception thrown: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af6e9591-75a8-4de5-a863-986e5b089dd8 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Request method failure captured: May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 HTTP/1.1 May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bi7fEIcKDawGHcsmwrGQlVw4ugZt7vO1VBIaUZ8pRNOKBUUpLCmPdj5min2Iq7erEZEsV2ugkZcj697TDoQZr3HQJEp_hzBTfxm7ee3tqdlVaX5Lq08HYVGCd10YVuj4tryWQ6w2Uneurn7JJsyysH9PDV880cVKgqHGa1e9DUtr0 May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 87a842d33e6043a99b1cfa595a06c723 May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:47:55.581964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 87a842d33e6043a99b1cfa595a06c723 May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesSnapshotsTestJSON-498106555-project May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 3a709d15f5534cf398c2ead09627b09c May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesSnapshotsTestJSON-498106555-project May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': 'd8c8f197-f10a-4411-9a11-b1f324bfc3e4'} May 26 12:47:55.584325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. (HTTP 404) (Request-ID: req-e0910c71-8c06-4b84-ad47-ac164bc8ee7e) May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.585550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:47:55.586803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:47:55.587977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af6e9591-75a8-4de5-a863-986e5b089dd8 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Returning 404 to user: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af6e9591-75a8-4de5-a863-986e5b089dd8 tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 404 len: 109 microversion: 2.1 time: 0.080311 May 26 12:47:55.589101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 32/65] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 12:47:55 2022] DELETE /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:55.592374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a16de884-bf1c-4e0f-9239-04cc3964ef7e tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Calling method '.version_select at 0x7f498d9ff0d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.673255 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8141208f-dc94-4ac3-b630-dbf82286a882 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.673916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8141208f-dc94-4ac3-b630-dbf82286a882 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:55.681972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8141208f-dc94-4ac3-b630-dbf82286a882 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.682460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8141208f-dc94-4ac3-b630-dbf82286a882 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.683323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8141208f-dc94-4ac3-b630-dbf82286a882 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.683751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8141208f-dc94-4ac3-b630-dbf82286a882 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.763510 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8141208f-dc94-4ac3-b630-dbf82286a882 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:55.783415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8141208f-dc94-4ac3-b630-dbf82286a882 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.105643 May 26 12:47:55.783415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 33/66] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:55 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:55.793559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-a16de884-bf1c-4e0f-9239-04cc3964ef7e tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] HTTP exception thrown: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a16de884-bf1c-4e0f-9239-04cc3964ef7e tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Request method failure captured: May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 HTTP/1.1 May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bi7fEIcKDawGHcsmwrGQlVw4ugZt7vO1VBIaUZ8pRNOKBUUpLCmPdj5min2Iq7erEZEsV2ugkZcj697TDoQZr3HQJEp_hzBTfxm7ee3tqdlVaX5Lq08HYVGCd10YVuj4tryWQ6w2Uneurn7JJsyysH9PDV880cVKgqHGa1e9DUtr0 May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 87a842d33e6043a99b1cfa595a06c723 May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:47:55.795578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/87a842d33e6043a99b1cfa595a06c723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 87a842d33e6043a99b1cfa595a06c723 May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-498106555 May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotsTestJSON-498106555-project May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 3a709d15f5534cf398c2ead09627b09c May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-498106555-project May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'd8c8f197-f10a-4411-9a11-b1f324bfc3e4'} May 26 12:47:55.796980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. (HTTP 404) (Request-ID: req-673058fc-9ca5-411d-9638-44382127548e) May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.797796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:47:55.798953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:47:55.800244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a16de884-bf1c-4e0f-9239-04cc3964ef7e tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] Returning 404 to user: Volume d8c8f197-f10a-4411-9a11-b1f324bfc3e4 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a16de884-bf1c-4e0f-9239-04cc3964ef7e tempest-VolumesSnapshotsTestJSON-498106555 tempest-VolumesSnapshotsTestJSON-498106555-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4" status: 404 len: 109 microversion: 2.1 time: 0.210471 May 26 12:47:55.802402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 34/67] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:47:55 2022] GET /compute/v2.1/os-volumes/d8c8f197-f10a-4411-9a11-b1f324bfc3e4 => generated 109 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:55.944007 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89bf54fc-254c-44bb-ba0a-a9bca222af9b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.953916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89bf54fc-254c-44bb-ba0a-a9bca222af9b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:55.957645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89bf54fc-254c-44bb-ba0a-a9bca222af9b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.959065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89bf54fc-254c-44bb-ba0a-a9bca222af9b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.962586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89bf54fc-254c-44bb-ba0a-a9bca222af9b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.963144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89bf54fc-254c-44bb-ba0a-a9bca222af9b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:56.081180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89bf54fc-254c-44bb-ba0a-a9bca222af9b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:56.086851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89bf54fc-254c-44bb-ba0a-a9bca222af9b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1245 microversion: 2.1 time: 0.150673 May 26 12:47:56.091404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 34/68] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:55 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1245 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:56.453695 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e85c0111-5f37-45f9-bd3e-03ce8e55b116 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:56.455132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e85c0111-5f37-45f9-bd3e-03ce8e55b116 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:56.463153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e85c0111-5f37-45f9-bd3e-03ce8e55b116 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:56.463615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e85c0111-5f37-45f9-bd3e-03ce8e55b116 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:56.464642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e85c0111-5f37-45f9-bd3e-03ce8e55b116 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:56.465292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e85c0111-5f37-45f9-bd3e-03ce8e55b116 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:56.696094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e85c0111-5f37-45f9-bd3e-03ce8e55b116 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:56.704034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e85c0111-5f37-45f9-bd3e-03ce8e55b116 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.254329 May 26 12:47:56.708907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 35/69] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:56 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:56.796138 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-558aae5f-9d6e-4141-91cc-9c5e081ae7a8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:56.797283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-558aae5f-9d6e-4141-91cc-9c5e081ae7a8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:56.813510 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-558aae5f-9d6e-4141-91cc-9c5e081ae7a8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:56.814247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-558aae5f-9d6e-4141-91cc-9c5e081ae7a8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:56.815957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-558aae5f-9d6e-4141-91cc-9c5e081ae7a8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:56.825850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-558aae5f-9d6e-4141-91cc-9c5e081ae7a8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.001121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-558aae5f-9d6e-4141-91cc-9c5e081ae7a8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:57.011873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-558aae5f-9d6e-4141-91cc-9c5e081ae7a8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.224695 May 26 12:47:57.016075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 35/70] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:56 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:57.109375 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5b217d66-c81e-4b4c-b68e-13289747ff1f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:57.110351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5b217d66-c81e-4b4c-b68e-13289747ff1f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:57.124664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b217d66-c81e-4b4c-b68e-13289747ff1f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:57.126033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b217d66-c81e-4b4c-b68e-13289747ff1f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.127075 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b217d66-c81e-4b4c-b68e-13289747ff1f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:57.130739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b217d66-c81e-4b4c-b68e-13289747ff1f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.223616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5b217d66-c81e-4b4c-b68e-13289747ff1f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:57.234710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5b217d66-c81e-4b4c-b68e-13289747ff1f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1245 microversion: 2.1 time: 0.130088 May 26 12:47:57.235538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 36/71] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:57 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:57.725869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c371cb70-9466-4632-a8ce-934b016e95fc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:57.736871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c371cb70-9466-4632-a8ce-934b016e95fc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:57.743582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:57.745569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c371cb70-9466-4632-a8ce-934b016e95fc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:57.746232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c371cb70-9466-4632-a8ce-934b016e95fc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.751407 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c371cb70-9466-4632-a8ce-934b016e95fc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:57.752099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c371cb70-9466-4632-a8ce-934b016e95fc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.943611 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c371cb70-9466-4632-a8ce-934b016e95fc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:57.953642 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c371cb70-9466-4632-a8ce-934b016e95fc tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.232195 May 26 12:47:57.954503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 36/72] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:57 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:58.032203 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-388d1aba-d50f-470f-b959-bc55b6f0f674 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:58.032956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-388d1aba-d50f-470f-b959-bc55b6f0f674 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:58.041162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-388d1aba-d50f-470f-b959-bc55b6f0f674 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:58.041626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-388d1aba-d50f-470f-b959-bc55b6f0f674 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:58.042490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-388d1aba-d50f-470f-b959-bc55b6f0f674 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:58.042990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-388d1aba-d50f-470f-b959-bc55b6f0f674 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:58.116282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-388d1aba-d50f-470f-b959-bc55b6f0f674 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:58.126822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-388d1aba-d50f-470f-b959-bc55b6f0f674 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.097476 May 26 12:47:58.126822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 37/73] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:58 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:58.255493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95746a53-a201-423c-8b5d-2db175c3b347 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:58.256142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95746a53-a201-423c-8b5d-2db175c3b347 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:58.291371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95746a53-a201-423c-8b5d-2db175c3b347 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:58.294444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95746a53-a201-423c-8b5d-2db175c3b347 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:58.295351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95746a53-a201-423c-8b5d-2db175c3b347 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:58.295794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95746a53-a201-423c-8b5d-2db175c3b347 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:58.389597 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95746a53-a201-423c-8b5d-2db175c3b347 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:58.393243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:58.398333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95746a53-a201-423c-8b5d-2db175c3b347 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1245 microversion: 2.1 time: 0.149543 May 26 12:47:58.398933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 37/74] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:58 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1245 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:58.972346 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49535859-8783-4412-b71e-fd3d5830e94b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:58.972346 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49535859-8783-4412-b71e-fd3d5830e94b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:59.001589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49535859-8783-4412-b71e-fd3d5830e94b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.001589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49535859-8783-4412-b71e-fd3d5830e94b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.001589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49535859-8783-4412-b71e-fd3d5830e94b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.001589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49535859-8783-4412-b71e-fd3d5830e94b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.143755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9bfb3bce-c899-48fb-a65e-7add71491464 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:59.145992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9bfb3bce-c899-48fb-a65e-7add71491464 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:59.157346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bfb3bce-c899-48fb-a65e-7add71491464 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.158311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bfb3bce-c899-48fb-a65e-7add71491464 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.161514 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bfb3bce-c899-48fb-a65e-7add71491464 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.162914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bfb3bce-c899-48fb-a65e-7add71491464 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.189255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49535859-8783-4412-b71e-fd3d5830e94b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:59.213917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49535859-8783-4412-b71e-fd3d5830e94b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.246671 May 26 12:47:59.220767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 38/75] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:58 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:59.266416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9bfb3bce-c899-48fb-a65e-7add71491464 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:59.294771 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9bfb3bce-c899-48fb-a65e-7add71491464 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.149245 May 26 12:47:59.294771 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 38/76] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:59 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:59.418046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-425666bd-b306-4139-9146-f58cc8cd26b9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:59.419020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-425666bd-b306-4139-9146-f58cc8cd26b9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:59.432616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-425666bd-b306-4139-9146-f58cc8cd26b9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.433077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-425666bd-b306-4139-9146-f58cc8cd26b9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.434042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-425666bd-b306-4139-9146-f58cc8cd26b9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.434683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-425666bd-b306-4139-9146-f58cc8cd26b9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.534035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-425666bd-b306-4139-9146-f58cc8cd26b9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:59.547863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-425666bd-b306-4139-9146-f58cc8cd26b9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1245 microversion: 2.1 time: 0.134572 May 26 12:47:59.562930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 39/77] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:47:59 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:00.237548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-018ab0d8-3a77-43d6-987d-9e1596690748 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:00.238165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-018ab0d8-3a77-43d6-987d-9e1596690748 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:00.245192 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:00.253033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:00.253033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-018ab0d8-3a77-43d6-987d-9e1596690748 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:00.253033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-018ab0d8-3a77-43d6-987d-9e1596690748 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.253033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-018ab0d8-3a77-43d6-987d-9e1596690748 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:00.253507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-018ab0d8-3a77-43d6-987d-9e1596690748 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.310417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-148ce38b-55bb-4e67-a8c2-4c766df9d391 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:00.312728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-148ce38b-55bb-4e67-a8c2-4c766df9d391 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:00.334121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-148ce38b-55bb-4e67-a8c2-4c766df9d391 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:00.335634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-148ce38b-55bb-4e67-a8c2-4c766df9d391 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.341906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-148ce38b-55bb-4e67-a8c2-4c766df9d391 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:00.342397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-148ce38b-55bb-4e67-a8c2-4c766df9d391 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.448725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-018ab0d8-3a77-43d6-987d-9e1596690748 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:00.459114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-018ab0d8-3a77-43d6-987d-9e1596690748 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.225521 May 26 12:48:00.460211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 39/78] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:00 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:00.492194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-148ce38b-55bb-4e67-a8c2-4c766df9d391 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:00.500503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-148ce38b-55bb-4e67-a8c2-4c766df9d391 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1225 microversion: 2.1 time: 0.198948 May 26 12:48:00.502918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 40/79] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:00 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1225 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:00.574320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cebbabdf-f794-4a76-8d7f-12a4a9506a06 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:00.575654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cebbabdf-f794-4a76-8d7f-12a4a9506a06 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:00.597535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cebbabdf-f794-4a76-8d7f-12a4a9506a06 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:00.598565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cebbabdf-f794-4a76-8d7f-12a4a9506a06 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.603485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cebbabdf-f794-4a76-8d7f-12a4a9506a06 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:00.604663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cebbabdf-f794-4a76-8d7f-12a4a9506a06 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.745953 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cebbabdf-f794-4a76-8d7f-12a4a9506a06 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:00.763042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cebbabdf-f794-4a76-8d7f-12a4a9506a06 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1245 microversion: 2.1 time: 0.193125 May 26 12:48:00.765166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 40/80] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:00 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1245 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:01.080144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:01.290859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fcbbc9a6-b6a2-4ba3-8dd1-99827ddc8f3a tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Action: 'create', calling method: .version_select at 0x7f498c689040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1451981017", "metadata": {"Type": "work"}}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:01.484678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5495000e-5b38-4a5a-9cfe-c23873468b63 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:01.485586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5495000e-5b38-4a5a-9cfe-c23873468b63 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:01.495291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5495000e-5b38-4a5a-9cfe-c23873468b63 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.495742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5495000e-5b38-4a5a-9cfe-c23873468b63 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.496709 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5495000e-5b38-4a5a-9cfe-c23873468b63 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.497205 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5495000e-5b38-4a5a-9cfe-c23873468b63 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.557098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=16 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:01.856749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5495000e-5b38-4a5a-9cfe-c23873468b63 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:01.884467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5495000e-5b38-4a5a-9cfe-c23873468b63 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.398140 May 26 12:48:01.895379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 41/81] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:01 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:01.909795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aa1987f3-1eb9-4fa8-872e-acb5ef4e81a0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:01.911470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aa1987f3-1eb9-4fa8-872e-acb5ef4e81a0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:01.924135 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa1987f3-1eb9-4fa8-872e-acb5ef4e81a0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.924135 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa1987f3-1eb9-4fa8-872e-acb5ef4e81a0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.924917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa1987f3-1eb9-4fa8-872e-acb5ef4e81a0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.925595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa1987f3-1eb9-4fa8-872e-acb5ef4e81a0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.018812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aa1987f3-1eb9-4fa8-872e-acb5ef4e81a0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.027287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aa1987f3-1eb9-4fa8-872e-acb5ef4e81a0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1217 microversion: 2.1 time: 0.130329 May 26 12:48:02.034632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 42/82] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:01 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:02.034632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46f48b6c-d64c-48c2-8266-c11671a0486b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:02.034632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46f48b6c-d64c-48c2-8266-c11671a0486b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:02.045971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46f48b6c-d64c-48c2-8266-c11671a0486b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.046434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46f48b6c-d64c-48c2-8266-c11671a0486b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.047288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46f48b6c-d64c-48c2-8266-c11671a0486b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.047754 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46f48b6c-d64c-48c2-8266-c11671a0486b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.123825 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46f48b6c-d64c-48c2-8266-c11671a0486b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.132591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46f48b6c-d64c-48c2-8266-c11671a0486b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1237 microversion: 2.1 time: 0.103651 May 26 12:48:02.133174 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 43/83] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:02 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:02.772282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fcbbc9a6-b6a2-4ba3-8dd1-99827ddc8f3a tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.696723 May 26 12:48:02.773279 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 41/84] 10.222.0.60 () {60 vars in 1155 bytes} [Thu May 26 12:48:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1699 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 12:48:02.784559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c85fa97-c9ae-4575-a13e-4f6acfb1fe84 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Calling method '.version_select at 0x7f498c5fa280>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:02.912504 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c04c4d58-62a5-44f1-a318-93999600e9c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:02.913438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c04c4d58-62a5-44f1-a318-93999600e9c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:02.919831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c04c4d58-62a5-44f1-a318-93999600e9c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.920507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c04c4d58-62a5-44f1-a318-93999600e9c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.921488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c04c4d58-62a5-44f1-a318-93999600e9c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.921935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c04c4d58-62a5-44f1-a318-93999600e9c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.041146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c85fa97-c9ae-4575-a13e-4f6acfb1fe84 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79" status: 200 len: 353 microversion: 2.1 time: 0.260195 May 26 12:48:03.049333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 44/85] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:48:02 2022] GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79 => generated 353 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:03.051384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b33900cb-7fcb-4bff-b3a0-77f25c97d00d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:03.052626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b33900cb-7fcb-4bff-b3a0-77f25c97d00d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:03.059175 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b33900cb-7fcb-4bff-b3a0-77f25c97d00d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.059646 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b33900cb-7fcb-4bff-b3a0-77f25c97d00d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.060437 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b33900cb-7fcb-4bff-b3a0-77f25c97d00d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.060880 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b33900cb-7fcb-4bff-b3a0-77f25c97d00d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.100543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c04c4d58-62a5-44f1-a318-93999600e9c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:03.124065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c04c4d58-62a5-44f1-a318-93999600e9c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.216232 May 26 12:48:03.124735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 42/86] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:02 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:03.162911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b33900cb-7fcb-4bff-b3a0-77f25c97d00d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:03.172688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b33900cb-7fcb-4bff-b3a0-77f25c97d00d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1217 microversion: 2.1 time: 0.125344 May 26 12:48:03.173274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 45/87] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:03 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:03.178247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca28699b-a2f2-419a-b255-65982071b5ca tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:03.178961 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ca28699b-a2f2-419a-b255-65982071b5ca tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:03.185416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca28699b-a2f2-419a-b255-65982071b5ca tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.186075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca28699b-a2f2-419a-b255-65982071b5ca tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.187291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca28699b-a2f2-419a-b255-65982071b5ca tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.194656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca28699b-a2f2-419a-b255-65982071b5ca tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.253354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ca28699b-a2f2-419a-b255-65982071b5ca tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:03.261662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ca28699b-a2f2-419a-b255-65982071b5ca tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1237 microversion: 2.1 time: 0.087161 May 26 12:48:03.262238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 46/88] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:03 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:03.305809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c10a2db2-07e9-47cd-b99c-78bd71673c18 req-f403f390-9a4e-4c00-b782-e554dbcd57b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a00e0a-5352-49bb-bb1e-b77d70358cfa", "tag": "dfcbc029-0888-4b38-8006-43ffa4bf81b4"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:03.317170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c10a2db2-07e9-47cd-b99c-78bd71673c18 req-f403f390-9a4e-4c00-b782-e554dbcd57b4 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.317726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c10a2db2-07e9-47cd-b99c-78bd71673c18 req-f403f390-9a4e-4c00-b782-e554dbcd57b4 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.343695 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c10a2db2-07e9-47cd-b99c-78bd71673c18 req-f403f390-9a4e-4c00-b782-e554dbcd57b4 service nova] Creating event network-changed:dfcbc029-0888-4b38-8006-43ffa4bf81b4 for instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa on hv-cinder-81514 May 26 12:48:03.344350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c10a2db2-07e9-47cd-b99c-78bd71673c18 req-f403f390-9a4e-4c00-b782-e554dbcd57b4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 12:48:03.345479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afc0033c-83c8-4467-b971-2563779bd22c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.345914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afc0033c-83c8-4467-b971-2563779bd22c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.346782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afc0033c-83c8-4467-b971-2563779bd22c None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.355252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afc0033c-83c8-4467-b971-2563779bd22c None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.357611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.compute.rpcapi [None req-afc0033c-83c8-4467-b971-2563779bd22c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 12:48:03.358514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afc0033c-83c8-4467-b971-2563779bd22c None None] Releasing lock "compute-rpcapi-router" {{(pid=124831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 12:48:03.377720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-afc0033c-83c8-4467-b971-2563779bd22c None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251415 May 26 12:48:03.378353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 43/89] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:04.057284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e5ab5e0-e53e-40bc-888d-bd3fc750e53e tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Calling method '.version_select at 0x7f498c6029d0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:04.143528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca6c9a6b-1964-49ea-b00d-4e5ff7e79f12 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:04.144908 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca6c9a6b-1964-49ea-b00d-4e5ff7e79f12 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:04.157991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6c9a6b-1964-49ea-b00d-4e5ff7e79f12 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.158474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6c9a6b-1964-49ea-b00d-4e5ff7e79f12 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.162989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6c9a6b-1964-49ea-b00d-4e5ff7e79f12 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.164105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6c9a6b-1964-49ea-b00d-4e5ff7e79f12 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.196268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e5ab5e0-e53e-40bc-888d-bd3fc750e53e tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79" status: 200 len: 354 microversion: 2.1 time: 0.144046 May 26 12:48:04.197158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 47/90] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:48:04 2022] GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79 => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:04.202124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-668721d4-1135-4379-bb82-3588b6428e40 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:04.203070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-668721d4-1135-4379-bb82-3588b6428e40 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:04.225022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-668721d4-1135-4379-bb82-3588b6428e40 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.228005 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-668721d4-1135-4379-bb82-3588b6428e40 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.229461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-668721d4-1135-4379-bb82-3588b6428e40 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.231744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-668721d4-1135-4379-bb82-3588b6428e40 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.379726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-668721d4-1135-4379-bb82-3588b6428e40 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.388730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-668721d4-1135-4379-bb82-3588b6428e40 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1273 microversion: 2.1 time: 0.190217 May 26 12:48:04.392473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 48/91] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:04 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:04.409426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65d5c925-30e8-4c05-9714-a3394bcdf68b tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Calling method '.version_select at 0x7f498c691820>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:04.432843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ca6c9a6b-1964-49ea-b00d-4e5ff7e79f12 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.444347 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca6c9a6b-1964-49ea-b00d-4e5ff7e79f12 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.303225 May 26 12:48:04.444347 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 44/92] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:04 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:04.456213 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a92880cb-7d10-4edf-8854-331f84136260 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:04.456835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a92880cb-7d10-4edf-8854-331f84136260 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:04.463265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a92880cb-7d10-4edf-8854-331f84136260 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.476615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a92880cb-7d10-4edf-8854-331f84136260 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.476615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a92880cb-7d10-4edf-8854-331f84136260 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.476615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a92880cb-7d10-4edf-8854-331f84136260 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.476615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.513989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65d5c925-30e8-4c05-9714-a3394bcdf68b tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79" status: 200 len: 354 microversion: 2.1 time: 0.119503 May 26 12:48:04.521294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 49/93] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:48:04 2022] GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79 => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:04.526702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89cde999-2aa3-4573-98bb-64906141adda tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Calling method '.version_select at 0x7f498c58b8b0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:04.587253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a92880cb-7d10-4edf-8854-331f84136260 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.607679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a92880cb-7d10-4edf-8854-331f84136260 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1293 microversion: 2.1 time: 0.155276 May 26 12:48:04.609019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 45/94] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:04 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:05.015105 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89cde999-2aa3-4573-98bb-64906141adda tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79" status: 202 len: 0 microversion: 2.1 time: 0.492594 May 26 12:48:05.015738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 50/95] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 12:48:04 2022] DELETE /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:48:05.025598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a5370de3-494c-4592-b994-3669855bc482 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Calling method '.version_select at 0x7f498c689160>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:05.089855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a5370de3-494c-4592-b994-3669855bc482 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79" status: 200 len: 353 microversion: 2.1 time: 0.069873 May 26 12:48:05.091032 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 46/96] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:48:05 2022] GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:05.407481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-68507137-dd18-484c-bf6a-ab025561b17f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:05.408705 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-68507137-dd18-484c-bf6a-ab025561b17f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:05.416258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68507137-dd18-484c-bf6a-ab025561b17f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.416983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68507137-dd18-484c-bf6a-ab025561b17f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.417933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68507137-dd18-484c-bf6a-ab025561b17f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.418540 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68507137-dd18-484c-bf6a-ab025561b17f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.464527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9281c1ef-6c22-47e3-9d28-c915fb44f631 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:05.464527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9281c1ef-6c22-47e3-9d28-c915fb44f631 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:05.466302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9281c1ef-6c22-47e3-9d28-c915fb44f631 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.467026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9281c1ef-6c22-47e3-9d28-c915fb44f631 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.467953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9281c1ef-6c22-47e3-9d28-c915fb44f631 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.469165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9281c1ef-6c22-47e3-9d28-c915fb44f631 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.547489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-68507137-dd18-484c-bf6a-ab025561b17f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:05.558146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-68507137-dd18-484c-bf6a-ab025561b17f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1281 microversion: 2.1 time: 0.154487 May 26 12:48:05.558768 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 51/97] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:05 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:05.626121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8bcb2419-160c-44c0-8fdd-b3614403b4e4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:05.626916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8bcb2419-160c-44c0-8fdd-b3614403b4e4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:05.636552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8bcb2419-160c-44c0-8fdd-b3614403b4e4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.639165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8bcb2419-160c-44c0-8fdd-b3614403b4e4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.640188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8bcb2419-160c-44c0-8fdd-b3614403b4e4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.644958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8bcb2419-160c-44c0-8fdd-b3614403b4e4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.784551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8bcb2419-160c-44c0-8fdd-b3614403b4e4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:05.803207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8bcb2419-160c-44c0-8fdd-b3614403b4e4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1311 microversion: 2.1 time: 0.181781 May 26 12:48:05.804035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 52/98] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:05 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:05.887106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9281c1ef-6c22-47e3-9d28-c915fb44f631 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:05.894627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9281c1ef-6c22-47e3-9d28-c915fb44f631 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.439788 May 26 12:48:05.895218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 47/99] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:05 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:06.107389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a1f5bb2f-bad9-40cb-8f91-e02e66e7b0e1 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Calling method '.version_select at 0x7f498c69b940>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:06.180473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-a1f5bb2f-bad9-40cb-8f91-e02e66e7b0e1 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] HTTP exception thrown: Volume 3ce8ff2e-f338-4706-85e6-7df7201ccb79 could not be found. May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a1f5bb2f-bad9-40cb-8f91-e02e66e7b0e1 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Request method failure captured: May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79 HTTP/1.1 May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3cA0Of86RiGB7Q4eisXpAvVPhep3gWzeR5iaAPWKQkrm01OdzWuUv-YpINzLg8qzP6HQ4cEue1Z3WN1gcVMO7iFEPoz0x_hMwQxw7W3zQggDESFlLWsAu3Ij9eCulGjgXnM02quNXZiKtsY5jvEW_KaDYZHFoNUsVsc7ZASbtF9SEE May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 8ca1a6641a164a51b7a3ee857f21bdb4 May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesGetTestJSON-83045196 May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:48:06.182974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ca1a6641a164a51b7a3ee857f21bdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ca1a6641a164a51b7a3ee857f21bdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ca1a6641a164a51b7a3ee857f21bdb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ca1a6641a164a51b7a3ee857f21bdb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesGetTestJSON-83045196 May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 8ca1a6641a164a51b7a3ee857f21bdb4 May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesGetTestJSON-83045196 May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesGetTestJSON-83045196-project May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 5a39cc0b714748d5a38c44f3178e22e2 May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesGetTestJSON-83045196-project May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Volume 3ce8ff2e-f338-4706-85e6-7df7201ccb79 could not be found. May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '3ce8ff2e-f338-4706-85e6-7df7201ccb79'} May 26 12:48:06.184640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ce8ff2e-f338-4706-85e6-7df7201ccb79 could not be found. (HTTP 404) (Request-ID: req-97d8d487-9f87-4efe-89ac-822e22cc5871) May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:06.185690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:48:06.187612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ce8ff2e-f338-4706-85e6-7df7201ccb79 could not be found. May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:48:06.188963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ce8ff2e-f338-4706-85e6-7df7201ccb79 could not be found. May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ce8ff2e-f338-4706-85e6-7df7201ccb79 could not be found. May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:06.190750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a1f5bb2f-bad9-40cb-8f91-e02e66e7b0e1 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] Returning 404 to user: Volume 3ce8ff2e-f338-4706-85e6-7df7201ccb79 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:06.191493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a1f5bb2f-bad9-40cb-8f91-e02e66e7b0e1 tempest-VolumesGetTestJSON-83045196 tempest-VolumesGetTestJSON-83045196-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79" status: 404 len: 109 microversion: 2.1 time: 0.089689 May 26 12:48:06.191823 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 53/100] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:48:06 2022] GET /compute/v2.1/os-volumes/3ce8ff2e-f338-4706-85e6-7df7201ccb79 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:48:06.577404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52501d8f-1fef-4f42-bc54-bb598f5c9328 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:06.578624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52501d8f-1fef-4f42-bc54-bb598f5c9328 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:06.581176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:06.586690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52501d8f-1fef-4f42-bc54-bb598f5c9328 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.587138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52501d8f-1fef-4f42-bc54-bb598f5c9328 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:06.588121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52501d8f-1fef-4f42-bc54-bb598f5c9328 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.588585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52501d8f-1fef-4f42-bc54-bb598f5c9328 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:06.665818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52501d8f-1fef-4f42-bc54-bb598f5c9328 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:06.674292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52501d8f-1fef-4f42-bc54-bb598f5c9328 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1279 microversion: 2.1 time: 0.100778 May 26 12:48:06.674964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 48/101] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:06 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:06.820946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-60f155e2-3a87-483a-a603-fd0344e650a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:06.821511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-60f155e2-3a87-483a-a603-fd0344e650a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:06.828810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60f155e2-3a87-483a-a603-fd0344e650a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.829279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60f155e2-3a87-483a-a603-fd0344e650a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:06.830066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60f155e2-3a87-483a-a603-fd0344e650a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.830508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60f155e2-3a87-483a-a603-fd0344e650a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:06.894647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-60f155e2-3a87-483a-a603-fd0344e650a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:06.903066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-60f155e2-3a87-483a-a603-fd0344e650a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1299 microversion: 2.1 time: 0.086519 May 26 12:48:06.903649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 54/102] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:06 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:06.916332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-238fcb4a-46d4-4833-a58c-02d68c4af11f tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:06.917353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-238fcb4a-46d4-4833-a58c-02d68c4af11f tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:06.925031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238fcb4a-46d4-4833-a58c-02d68c4af11f tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.925717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238fcb4a-46d4-4833-a58c-02d68c4af11f tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:06.926751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238fcb4a-46d4-4833-a58c-02d68c4af11f tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.927931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238fcb4a-46d4-4833-a58c-02d68c4af11f tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.340163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-238fcb4a-46d4-4833-a58c-02d68c4af11f tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:07.355651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-238fcb4a-46d4-4833-a58c-02d68c4af11f tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.445179 May 26 12:48:07.356246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 49/103] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:06 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:07.696595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-195fa039-5876-43b2-95fa-f782cde43681 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:07.696595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-195fa039-5876-43b2-95fa-f782cde43681 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:07.703351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-195fa039-5876-43b2-95fa-f782cde43681 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:07.705989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-195fa039-5876-43b2-95fa-f782cde43681 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.707194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-195fa039-5876-43b2-95fa-f782cde43681 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:07.707819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-195fa039-5876-43b2-95fa-f782cde43681 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.922014 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-191828ef-a130-4928-9352-54559bc90aec tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:07.922814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-191828ef-a130-4928-9352-54559bc90aec tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:07.931464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-191828ef-a130-4928-9352-54559bc90aec tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:07.932970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-191828ef-a130-4928-9352-54559bc90aec tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.937438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-191828ef-a130-4928-9352-54559bc90aec tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:07.937904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-191828ef-a130-4928-9352-54559bc90aec tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.968689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-195fa039-5876-43b2-95fa-f782cde43681 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:07.979570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-195fa039-5876-43b2-95fa-f782cde43681 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.291708 May 26 12:48:07.982191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 55/104] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:07 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:08.230050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-191828ef-a130-4928-9352-54559bc90aec tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.241713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-191828ef-a130-4928-9352-54559bc90aec tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.323716 May 26 12:48:08.242316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 50/105] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:07 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:08.376411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfafa50d-ade4-4a59-a1c9-bf82129a67d7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:08.377768 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bfafa50d-ade4-4a59-a1c9-bf82129a67d7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:08.386741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfafa50d-ade4-4a59-a1c9-bf82129a67d7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:08.388963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfafa50d-ade4-4a59-a1c9-bf82129a67d7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:08.389936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfafa50d-ade4-4a59-a1c9-bf82129a67d7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:08.390626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfafa50d-ade4-4a59-a1c9-bf82129a67d7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:08.687323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-f411952c-3170-4f4d-a8b1-ab76ae9aad52 req-10b3a019-6779-4c8e-b70d-fa1dfab306b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f291eb7-afa2-456e-8494-97b63e9f2144", "tag": "9b84c175-e682-4c14-95ef-351de4245754"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:08.699807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f411952c-3170-4f4d-a8b1-ab76ae9aad52 req-10b3a019-6779-4c8e-b70d-fa1dfab306b0 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:08.700259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f411952c-3170-4f4d-a8b1-ab76ae9aad52 req-10b3a019-6779-4c8e-b70d-fa1dfab306b0 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:08.716219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfafa50d-ade4-4a59-a1c9-bf82129a67d7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.728592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bfafa50d-ade4-4a59-a1c9-bf82129a67d7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.358890 May 26 12:48:08.729593 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 56/106] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:08 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:08.774962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-f411952c-3170-4f4d-a8b1-ab76ae9aad52 req-10b3a019-6779-4c8e-b70d-fa1dfab306b0 service nova] Creating event network-changed:9b84c175-e682-4c14-95ef-351de4245754 for instance 9f291eb7-afa2-456e-8494-97b63e9f2144 on hv-cinder-81514 May 26 12:48:08.787635 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-f411952c-3170-4f4d-a8b1-ab76ae9aad52 req-10b3a019-6779-4c8e-b70d-fa1dfab306b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301998 May 26 12:48:08.789257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 51/107] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:09.003617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c824a6ba-030f-4f61-9949-06d56f28c72d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:09.005112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c824a6ba-030f-4f61-9949-06d56f28c72d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:09.012610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c824a6ba-030f-4f61-9949-06d56f28c72d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.013435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c824a6ba-030f-4f61-9949-06d56f28c72d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.014436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c824a6ba-030f-4f61-9949-06d56f28c72d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.015119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c824a6ba-030f-4f61-9949-06d56f28c72d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.261623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c824a6ba-030f-4f61-9949-06d56f28c72d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.277121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c824a6ba-030f-4f61-9949-06d56f28c72d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.278621 May 26 12:48:09.281907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-24cc2cce-b068-4f5a-87bb-966accba52f5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:09.283550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-24cc2cce-b068-4f5a-87bb-966accba52f5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:09.288576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 57/108] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:08 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:09.313659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24cc2cce-b068-4f5a-87bb-966accba52f5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.314864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24cc2cce-b068-4f5a-87bb-966accba52f5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.320868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24cc2cce-b068-4f5a-87bb-966accba52f5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.321626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24cc2cce-b068-4f5a-87bb-966accba52f5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.750222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3f367675-b3f4-4e50-9cb8-b74b7a943e27 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:09.750971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3f367675-b3f4-4e50-9cb8-b74b7a943e27 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:09.760580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f367675-b3f4-4e50-9cb8-b74b7a943e27 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.761372 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f367675-b3f4-4e50-9cb8-b74b7a943e27 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.762608 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f367675-b3f4-4e50-9cb8-b74b7a943e27 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.763456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f367675-b3f4-4e50-9cb8-b74b7a943e27 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.966736 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24cc2cce-b068-4f5a-87bb-966accba52f5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.986767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-24cc2cce-b068-4f5a-87bb-966accba52f5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.721127 May 26 12:48:09.987896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 52/109] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:09 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:10.193408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f367675-b3f4-4e50-9cb8-b74b7a943e27 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.201791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f367675-b3f4-4e50-9cb8-b74b7a943e27 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.458387 May 26 12:48:10.202461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 58/110] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:09 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:10.295386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d0d7272a-fe6e-4bd5-8daf-2d3b4b7e3605 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:10.296003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d0d7272a-fe6e-4bd5-8daf-2d3b4b7e3605 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:10.302926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0d7272a-fe6e-4bd5-8daf-2d3b4b7e3605 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.303318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0d7272a-fe6e-4bd5-8daf-2d3b4b7e3605 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.304111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0d7272a-fe6e-4bd5-8daf-2d3b4b7e3605 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.304558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0d7272a-fe6e-4bd5-8daf-2d3b4b7e3605 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.517963 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0d7272a-fe6e-4bd5-8daf-2d3b4b7e3605 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.527537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d0d7272a-fe6e-4bd5-8daf-2d3b4b7e3605 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.235892 May 26 12:48:10.528450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 53/111] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:10 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:11.006897 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af584804-f332-4018-9cff-f6bc91b3a4f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:11.007793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-af584804-f332-4018-9cff-f6bc91b3a4f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:11.024089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-d8c62cb2-9d29-4c8e-adf4-73a9c4588693 req-3507503b-f05a-4b2b-8b2b-a8bd611312d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9a6c21-74a0-432e-bcb3-c91e2c45fe15", "tag": "b7901f5b-84cd-435a-aac3-53e7b431a21f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:11.024806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af584804-f332-4018-9cff-f6bc91b3a4f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.025273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af584804-f332-4018-9cff-f6bc91b3a4f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.026065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af584804-f332-4018-9cff-f6bc91b3a4f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.026568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af584804-f332-4018-9cff-f6bc91b3a4f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.047876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d8c62cb2-9d29-4c8e-adf4-73a9c4588693 req-3507503b-f05a-4b2b-8b2b-a8bd611312d9 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.049335 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d8c62cb2-9d29-4c8e-adf4-73a9c4588693 req-3507503b-f05a-4b2b-8b2b-a8bd611312d9 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.091601 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-d8c62cb2-9d29-4c8e-adf4-73a9c4588693 req-3507503b-f05a-4b2b-8b2b-a8bd611312d9 service nova] Creating event network-changed:b7901f5b-84cd-435a-aac3-53e7b431a21f for instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 on hv-cinder-81514 May 26 12:48:11.107561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-d8c62cb2-9d29-4c8e-adf4-73a9c4588693 req-3507503b-f05a-4b2b-8b2b-a8bd611312d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088154 May 26 12:48:11.108843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 54/112] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:11.111218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:11.219811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-279a0481-f162-4d2e-9291-ffb94eb160e3 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:11.220681 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-279a0481-f162-4d2e-9291-ffb94eb160e3 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:11.236929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-279a0481-f162-4d2e-9291-ffb94eb160e3 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.240206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-279a0481-f162-4d2e-9291-ffb94eb160e3 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.245050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-279a0481-f162-4d2e-9291-ffb94eb160e3 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.246230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-279a0481-f162-4d2e-9291-ffb94eb160e3 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.484592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af584804-f332-4018-9cff-f6bc91b3a4f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:11.492532 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af584804-f332-4018-9cff-f6bc91b3a4f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.490566 May 26 12:48:11.493515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 59/113] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:11 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:11.545424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d15dfb2-9449-4a4c-aa29-a1381e4882cf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:11.546336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d15dfb2-9449-4a4c-aa29-a1381e4882cf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:11.553598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d15dfb2-9449-4a4c-aa29-a1381e4882cf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.554061 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d15dfb2-9449-4a4c-aa29-a1381e4882cf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.554911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d15dfb2-9449-4a4c-aa29-a1381e4882cf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.555362 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d15dfb2-9449-4a4c-aa29-a1381e4882cf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.620209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-279a0481-f162-4d2e-9291-ffb94eb160e3 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:11.629756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-279a0481-f162-4d2e-9291-ffb94eb160e3 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.414215 May 26 12:48:11.640148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 55/114] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:11 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:11.723131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d15dfb2-9449-4a4c-aa29-a1381e4882cf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:11.745951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d15dfb2-9449-4a4c-aa29-a1381e4882cf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.192614 May 26 12:48:11.745951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 60/115] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:11 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:12.510994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f72bd244-6d55-4b30-a795-90e6a002a784 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:12.512081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f72bd244-6d55-4b30-a795-90e6a002a784 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:12.539152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f72bd244-6d55-4b30-a795-90e6a002a784 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.539152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f72bd244-6d55-4b30-a795-90e6a002a784 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:12.539152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f72bd244-6d55-4b30-a795-90e6a002a784 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.539152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f72bd244-6d55-4b30-a795-90e6a002a784 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:12.647906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-239e7a13-4222-41d1-a88e-2b06419f10e6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:12.648618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-239e7a13-4222-41d1-a88e-2b06419f10e6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:12.659788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-239e7a13-4222-41d1-a88e-2b06419f10e6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.663730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-239e7a13-4222-41d1-a88e-2b06419f10e6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:12.665199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-239e7a13-4222-41d1-a88e-2b06419f10e6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.665813 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-239e7a13-4222-41d1-a88e-2b06419f10e6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:12.698597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f72bd244-6d55-4b30-a795-90e6a002a784 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:12.708864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f72bd244-6d55-4b30-a795-90e6a002a784 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.203199 May 26 12:48:12.715071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 56/116] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:12 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:12.753285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-197027ee-ccdd-436f-bfb0-6705a4534269 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:12.753957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-197027ee-ccdd-436f-bfb0-6705a4534269 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:12.764977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-197027ee-ccdd-436f-bfb0-6705a4534269 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.768489 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-197027ee-ccdd-436f-bfb0-6705a4534269 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:12.769421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-197027ee-ccdd-436f-bfb0-6705a4534269 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.769947 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-197027ee-ccdd-436f-bfb0-6705a4534269 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:12.859308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-239e7a13-4222-41d1-a88e-2b06419f10e6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:12.867808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-239e7a13-4222-41d1-a88e-2b06419f10e6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.224262 May 26 12:48:12.869208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 61/117] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:12 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:12.942216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-197027ee-ccdd-436f-bfb0-6705a4534269 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:12.953244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-197027ee-ccdd-436f-bfb0-6705a4534269 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.203617 May 26 12:48:12.954170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 57/118] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:12 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:13.095826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ffcedc6-3629-439f-b533-9323498c8088 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Action: 'create', calling method: .version_select at 0x7f498c69b8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-652397426", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ffcedc6-3629-439f-b533-9323498c8088 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Request method failure captured: May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 121 May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3cMqhtykBjdNowY2pB5hWCOIBn4n_uH5-MoDeMTI4u77dPF7gVSSjIXE4NhqpwUzFKGf4kXFH9FRTGB0lRbK2iQYpFuOAhWZuTHjXgkK0x2_IPVNf2x0TeU2wH5jQvCaq9fzmBWlzEh0WWHnr2NwDaSQAQzzlNh2TlFaddqC65MirY May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:48:13.154289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 57532fb4488d4781beb860f6041cbfcd May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-652397426", "metadata": {"Type": "work"}}} May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: May 26 12:48:13.155742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-652397426', 'metadata': {'Type': 'work'}}}} May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise error May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi '#$%' May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:13.156605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:48:13.157964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:48:13.159281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:48:13.159281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.159281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ffcedc6-3629-439f-b533-9323498c8088 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:13.159281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0ffcedc6-3629-439f-b533-9323498c8088 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.286838 May 26 12:48:13.159281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 62/119] 10.222.0.60 () {60 vars in 1155 bytes} [Thu May 26 12:48:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:48:13.174014 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-5a7975be-601e-413f-b0b7-a62ae1a5f42f req-e4ca0649-54a7-47f4-9971-52b72a6a3e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0427d82f-3f18-4102-963b-6eab4c3a7bd5", "tag": "efe1db4b-2d32-49d2-9494-afad4976ae83"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:13.179244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5a7975be-601e-413f-b0b7-a62ae1a5f42f req-e4ca0649-54a7-47f4-9971-52b72a6a3e09 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.179708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5a7975be-601e-413f-b0b7-a62ae1a5f42f req-e4ca0649-54a7-47f4-9971-52b72a6a3e09 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.203270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-5a7975be-601e-413f-b0b7-a62ae1a5f42f req-e4ca0649-54a7-47f4-9971-52b72a6a3e09 service nova] Creating event network-changed:efe1db4b-2d32-49d2-9494-afad4976ae83 for instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 on hv-cinder-81514 May 26 12:48:13.204311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5a7975be-601e-413f-b0b7-a62ae1a5f42f req-e4ca0649-54a7-47f4-9971-52b72a6a3e09 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124830) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 12:48:13.205772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a92603b6-75c1-4ef9-a38c-3d2a6e7ff729 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.206382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a92603b6-75c1-4ef9-a38c-3d2a6e7ff729 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.207220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a92603b6-75c1-4ef9-a38c-3d2a6e7ff729 None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.212671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a92603b6-75c1-4ef9-a38c-3d2a6e7ff729 None None] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.217987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.compute.rpcapi [None req-a92603b6-75c1-4ef9-a38c-3d2a6e7ff729 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 12:48:13.218990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a92603b6-75c1-4ef9-a38c-3d2a6e7ff729 None None] Releasing lock "compute-rpcapi-router" {{(pid=124830) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 12:48:13.239218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a92603b6-75c1-4ef9-a38c-3d2a6e7ff729 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079884 May 26 12:48:13.241393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 63/120] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:13.248449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4cfdf4a1-6093-46c5-bf81-a40b6593c89a tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Action: 'create', calling method: .version_select at 0x7f498c773550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1113100847", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4cfdf4a1-6093-46c5-bf81-a40b6593c89a tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Request method failure captured: May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 120 May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3cMqhtykBjdNowY2pB5hWCOIBn4n_uH5-MoDeMTI4u77dPF7gVSSjIXE4NhqpwUzFKGf4kXFH9FRTGB0lRbK2iQYpFuOAhWZuTHjXgkK0x2_IPVNf2x0TeU2wH5jQvCaq9fzmBWlzEh0WWHnr2NwDaSQAQzzlNh2TlFaddqC65MirY May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:48:13.251292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 57532fb4488d4781beb860f6041cbfcd May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1113100847", "metadata": {"Type": "work"}}} May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: May 26 12:48:13.252633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1113100847', 'metadata': {'Type': 'work'}}}} May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise error May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi '0' May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:13.253394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:48:13.256408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:48:13.259183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:48:13.259183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.259183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4cfdf4a1-6093-46c5-bf81-a40b6593c89a tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:13.259183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4cfdf4a1-6093-46c5-bf81-a40b6593c89a tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009882 May 26 12:48:13.259183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 64/121] 10.222.0.60 () {60 vars in 1155 bytes} [Thu May 26 12:48:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:48:13.265726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e776acee-25f5-4a9f-895d-1c0ca4484a5e tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Action: 'create', calling method: .version_select at 0x7f498c602820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-396196983", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e776acee-25f5-4a9f-895d-1c0ca4484a5e tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Request method failure captured: May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 118 May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3cMqhtykBjdNowY2pB5hWCOIBn4n_uH5-MoDeMTI4u77dPF7gVSSjIXE4NhqpwUzFKGf4kXFH9FRTGB0lRbK2iQYpFuOAhWZuTHjXgkK0x2_IPVNf2x0TeU2wH5jQvCaq9fzmBWlzEh0WWHnr2NwDaSQAQzzlNh2TlFaddqC65MirY May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:48:13.269230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 57532fb4488d4781beb860f6041cbfcd May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-396196983", "metadata": {"Type": "work"}}} May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: May 26 12:48:13.270316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-396196983', 'metadata': {'Type': 'work'}}}} May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise error May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi '' May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:13.271861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:48:13.273044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:48:13.273953 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:48:13.273953 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.275718 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e776acee-25f5-4a9f-895d-1c0ca4484a5e tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:13.276837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e776acee-25f5-4a9f-895d-1c0ca4484a5e tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015216 May 26 12:48:13.277604 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 65/122] 10.222.0.60 () {60 vars in 1155 bytes} [Thu May 26 12:48:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:48:13.288449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a62c123d-29ae-41b4-a31f-3d539aada940 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Calling method '.version_select at 0x7f498c58b280>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:13.290103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-740199da-3b41-457e-ab16-d2357dd1c662 req-a6eb1a2f-1343-489d-bd58-0c3273ef946f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a00e0a-5352-49bb-bb1e-b77d70358cfa", "name": "network-vif-plugged", "status": "completed", "tag": "dfcbc029-0888-4b38-8006-43ffa4bf81b4"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:13.299058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-740199da-3b41-457e-ab16-d2357dd1c662 req-a6eb1a2f-1343-489d-bd58-0c3273ef946f service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.299521 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-740199da-3b41-457e-ab16-d2357dd1c662 req-a6eb1a2f-1343-489d-bd58-0c3273ef946f service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.315779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-740199da-3b41-457e-ab16-d2357dd1c662 req-a6eb1a2f-1343-489d-bd58-0c3273ef946f service nova] Creating event network-vif-plugged:dfcbc029-0888-4b38-8006-43ffa4bf81b4 for instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa on hv-cinder-81514 May 26 12:48:13.324052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-740199da-3b41-457e-ab16-d2357dd1c662 req-a6eb1a2f-1343-489d-bd58-0c3273ef946f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324597 May 26 12:48:13.324725 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 58/123] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:13.326000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-a62c123d-29ae-41b4-a31f-3d539aada940 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] HTTP exception thrown: Volume tempest-invalid-1333876506 could not be found. May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a62c123d-29ae-41b4-a31f-3d539aada940 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Request method failure captured: May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1333876506 HTTP/1.1 May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3cMqhtykBjdNowY2pB5hWCOIBn4n_uH5-MoDeMTI4u77dPF7gVSSjIXE4NhqpwUzFKGf4kXFH9FRTGB0lRbK2iQYpFuOAhWZuTHjXgkK0x2_IPVNf2x0TeU2wH5jQvCaq9fzmBWlzEh0WWHnr2NwDaSQAQzzlNh2TlFaddqC65MirY May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:48:13.335166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 57532fb4488d4781beb860f6041cbfcd May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Volume tempest-invalid-1333876506 could not be found. May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': 'tempest-invalid-1333876506'} May 26 12:48:13.336547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1333876506 could not be found. (HTTP 404) (Request-ID: req-6be676b4-0c3f-4ba9-bf31-674c0fd237b4) May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.337410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:48:13.338581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1333876506 could not be found. May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:48:13.339781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1333876506 could not be found. May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1333876506 could not be found. May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a62c123d-29ae-41b4-a31f-3d539aada940 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Returning 404 to user: Volume tempest-invalid-1333876506 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a62c123d-29ae-41b4-a31f-3d539aada940 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1333876506" status: 404 len: 99 microversion: 2.1 time: 0.045503 May 26 12:48:13.341165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 66/124] 10.222.0.60 () {58 vars in 1217 bytes} [Thu May 26 12:48:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1333876506 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 12:48:13.344776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e4f0b18-f66c-475a-a1bc-fcc82fe9c3a7 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008139 May 26 12:48:13.345687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 59/125] 10.222.0.60 () {58 vars in 1139 bytes} [Thu May 26 12:48:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 12:48:13.356507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f43d402-a690-4cb1-9a53-eef8395d0e77 tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004540 May 26 12:48:13.357045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 67/126] 10.222.0.60 () {58 vars in 1136 bytes} [Thu May 26 12:48:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 12:48:13.363617 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:13.368982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bec835fc-bcd9-42f4-b20c-71e41fc3181f tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Calling method '.version_select at 0x7f498c6898b0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:13.416424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-bec835fc-bcd9-42f4-b20c-71e41fc3181f tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] HTTP exception thrown: Volume 318a5f7e-4356-41f6-8601-655a66303d25 could not be found. May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bec835fc-bcd9-42f4-b20c-71e41fc3181f tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Request method failure captured: May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/os-volumes/318a5f7e-4356-41f6-8601-655a66303d25 HTTP/1.1 May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3cMqhtykBjdNowY2pB5hWCOIBn4n_uH5-MoDeMTI4u77dPF7gVSSjIXE4NhqpwUzFKGf4kXFH9FRTGB0lRbK2iQYpFuOAhWZuTHjXgkK0x2_IPVNf2x0TeU2wH5jQvCaq9fzmBWlzEh0WWHnr2NwDaSQAQzzlNh2TlFaddqC65MirY May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:48:13.419015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 57532fb4488d4781beb860f6041cbfcd May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Volume 318a5f7e-4356-41f6-8601-655a66303d25 could not be found. May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '318a5f7e-4356-41f6-8601-655a66303d25'} May 26 12:48:13.420177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 318a5f7e-4356-41f6-8601-655a66303d25 could not be found. (HTTP 404) (Request-ID: req-0c0eff67-ca82-4843-9a21-d6cd00a1b24d) May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.420854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:48:13.421765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 318a5f7e-4356-41f6-8601-655a66303d25 could not be found. May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:48:13.434416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 318a5f7e-4356-41f6-8601-655a66303d25 could not be found. May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 318a5f7e-4356-41f6-8601-655a66303d25 could not be found. May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bec835fc-bcd9-42f4-b20c-71e41fc3181f tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Returning 404 to user: Volume 318a5f7e-4356-41f6-8601-655a66303d25 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bec835fc-bcd9-42f4-b20c-71e41fc3181f tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/318a5f7e-4356-41f6-8601-655a66303d25" status: 404 len: 109 microversion: 2.1 time: 0.063804 May 26 12:48:13.435745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 60/127] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 12:48:13 2022] DELETE /compute/v2.1/os-volumes/318a5f7e-4356-41f6-8601-655a66303d25 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:48:13.436729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9a2d2080-6bd4-4cfb-921e-1b7537eec68c tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Calling method '.version_select at 0x7f498c773a60>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:13.477176 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-9a2d2080-6bd4-4cfb-921e-1b7537eec68c tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] HTTP exception thrown: Volume 59c9100b-ea94-42d4-ac6b-dd56b530cc56 could not be found. May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9a2d2080-6bd4-4cfb-921e-1b7537eec68c tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Request method failure captured: May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/os-volumes/59c9100b-ea94-42d4-ac6b-dd56b530cc56 HTTP/1.1 May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3cMqhtykBjdNowY2pB5hWCOIBn4n_uH5-MoDeMTI4u77dPF7gVSSjIXE4NhqpwUzFKGf4kXFH9FRTGB0lRbK2iQYpFuOAhWZuTHjXgkK0x2_IPVNf2x0TeU2wH5jQvCaq9fzmBWlzEh0WWHnr2NwDaSQAQzzlNh2TlFaddqC65MirY May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:48:13.479765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05eea16eae2b4e57a6dcff0f105f23ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 05eea16eae2b4e57a6dcff0f105f23ec May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-125807638 May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 57532fb4488d4781beb860f6041cbfcd May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-125807638-project May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Volume 59c9100b-ea94-42d4-ac6b-dd56b530cc56 could not be found. May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '59c9100b-ea94-42d4-ac6b-dd56b530cc56'} May 26 12:48:13.482224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59c9100b-ea94-42d4-ac6b-dd56b530cc56 could not be found. (HTTP 404) (Request-ID: req-8389942b-1bfa-4b4f-8f2f-7bad671e5f57) May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.483652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:48:13.485765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59c9100b-ea94-42d4-ac6b-dd56b530cc56 could not be found. May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:48:13.490672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59c9100b-ea94-42d4-ac6b-dd56b530cc56 could not be found. May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59c9100b-ea94-42d4-ac6b-dd56b530cc56 could not be found. May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9a2d2080-6bd4-4cfb-921e-1b7537eec68c tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] Returning 404 to user: Volume 59c9100b-ea94-42d4-ac6b-dd56b530cc56 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9a2d2080-6bd4-4cfb-921e-1b7537eec68c tempest-VolumesNegativeTest-125807638 tempest-VolumesNegativeTest-125807638-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/59c9100b-ea94-42d4-ac6b-dd56b530cc56" status: 404 len: 109 microversion: 2.1 time: 0.049340 May 26 12:48:13.493616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 68/128] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 26 12:48:13 2022] GET /compute/v2.1/os-volumes/59c9100b-ea94-42d4-ac6b-dd56b530cc56 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:48:13.731121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a91f127-2191-494d-bc87-7392ed2b5c3a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:13.733023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a91f127-2191-494d-bc87-7392ed2b5c3a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:13.742319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a91f127-2191-494d-bc87-7392ed2b5c3a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.743339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a91f127-2191-494d-bc87-7392ed2b5c3a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.745404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a91f127-2191-494d-bc87-7392ed2b5c3a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.746130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a91f127-2191-494d-bc87-7392ed2b5c3a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.885327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1a0ab213-dae5-4c1e-84fa-29e63ec3bb70 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:13.886773 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1a0ab213-dae5-4c1e-84fa-29e63ec3bb70 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:13.895724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a0ab213-dae5-4c1e-84fa-29e63ec3bb70 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.895724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a0ab213-dae5-4c1e-84fa-29e63ec3bb70 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.895724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a0ab213-dae5-4c1e-84fa-29e63ec3bb70 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.902301 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a0ab213-dae5-4c1e-84fa-29e63ec3bb70 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.015409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a91f127-2191-494d-bc87-7392ed2b5c3a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.027451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a91f127-2191-494d-bc87-7392ed2b5c3a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.301711 May 26 12:48:14.037653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 61/129] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:13 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:14.045376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4da2111-9417-4ff0-81e1-bed5779f3f67 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:14.046173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d4da2111-9417-4ff0-81e1-bed5779f3f67 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:14.054644 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4da2111-9417-4ff0-81e1-bed5779f3f67 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.056366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4da2111-9417-4ff0-81e1-bed5779f3f67 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.059994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4da2111-9417-4ff0-81e1-bed5779f3f67 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.059994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4da2111-9417-4ff0-81e1-bed5779f3f67 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.271791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d4da2111-9417-4ff0-81e1-bed5779f3f67 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.285807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d4da2111-9417-4ff0-81e1-bed5779f3f67 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.246896 May 26 12:48:14.287210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 62/130] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:14 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:14.449048 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a0ab213-dae5-4c1e-84fa-29e63ec3bb70 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.460557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1a0ab213-dae5-4c1e-84fa-29e63ec3bb70 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.579113 May 26 12:48:14.463485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 69/131] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:13 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:15.049835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b72cbe4c-d84a-43dd-a445-230072c57ff7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:15.051167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b72cbe4c-d84a-43dd-a445-230072c57ff7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:15.057610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b72cbe4c-d84a-43dd-a445-230072c57ff7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.058299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b72cbe4c-d84a-43dd-a445-230072c57ff7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.059170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b72cbe4c-d84a-43dd-a445-230072c57ff7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.059615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b72cbe4c-d84a-43dd-a445-230072c57ff7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.222035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b72cbe4c-d84a-43dd-a445-230072c57ff7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.232041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b72cbe4c-d84a-43dd-a445-230072c57ff7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.186420 May 26 12:48:15.233171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 63/132] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:15 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:15.303923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-26d16dff-22e7-4be7-aa7c-2f1b5f9b0d56 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:15.304552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-26d16dff-22e7-4be7-aa7c-2f1b5f9b0d56 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:15.311347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26d16dff-22e7-4be7-aa7c-2f1b5f9b0d56 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.311801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26d16dff-22e7-4be7-aa7c-2f1b5f9b0d56 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.312766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26d16dff-22e7-4be7-aa7c-2f1b5f9b0d56 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.313298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26d16dff-22e7-4be7-aa7c-2f1b5f9b0d56 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.482586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92a50439-e75a-4f11-96e1-e99c28318227 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:15.483495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92a50439-e75a-4f11-96e1-e99c28318227 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:15.493826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92a50439-e75a-4f11-96e1-e99c28318227 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.494280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92a50439-e75a-4f11-96e1-e99c28318227 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.495920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92a50439-e75a-4f11-96e1-e99c28318227 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.495920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92a50439-e75a-4f11-96e1-e99c28318227 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.718349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-26d16dff-22e7-4be7-aa7c-2f1b5f9b0d56 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.738368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-26d16dff-22e7-4be7-aa7c-2f1b5f9b0d56 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.438446 May 26 12:48:15.743225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 70/133] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:15 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:15.793779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92a50439-e75a-4f11-96e1-e99c28318227 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.805556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92a50439-e75a-4f11-96e1-e99c28318227 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.327062 May 26 12:48:15.806543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 64/134] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:15 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:16.249386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d036317-c4e7-4bcb-9675-2f286c813433 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:16.250002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d036317-c4e7-4bcb-9675-2f286c813433 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:16.257120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d036317-c4e7-4bcb-9675-2f286c813433 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.257583 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d036317-c4e7-4bcb-9675-2f286c813433 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.258429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d036317-c4e7-4bcb-9675-2f286c813433 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.258841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d036317-c4e7-4bcb-9675-2f286c813433 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.355506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-4746933f-a468-445c-94f2-c6bde45b3077 req-65fccd6b-310b-49ff-b09e-56fd6f5884cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f291eb7-afa2-456e-8494-97b63e9f2144", "name": "network-vif-plugged", "status": "completed", "tag": "9b84c175-e682-4c14-95ef-351de4245754"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:16.366124 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4746933f-a468-445c-94f2-c6bde45b3077 req-65fccd6b-310b-49ff-b09e-56fd6f5884cc service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.366892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4746933f-a468-445c-94f2-c6bde45b3077 req-65fccd6b-310b-49ff-b09e-56fd6f5884cc service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.384463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-4746933f-a468-445c-94f2-c6bde45b3077 req-65fccd6b-310b-49ff-b09e-56fd6f5884cc service nova] Creating event network-vif-plugged:9b84c175-e682-4c14-95ef-351de4245754 for instance 9f291eb7-afa2-456e-8494-97b63e9f2144 on hv-cinder-81514 May 26 12:48:16.393473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-4746933f-a468-445c-94f2-c6bde45b3077 req-65fccd6b-310b-49ff-b09e-56fd6f5884cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042263 May 26 12:48:16.394405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 65/135] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:16.415360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d036317-c4e7-4bcb-9675-2f286c813433 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.423001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d036317-c4e7-4bcb-9675-2f286c813433 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.177460 May 26 12:48:16.423676 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 71/136] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:16 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:16.756794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c349a3f0-c93e-4112-8040-b05f1f6eea1d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:16.757600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c349a3f0-c93e-4112-8040-b05f1f6eea1d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:16.764097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c349a3f0-c93e-4112-8040-b05f1f6eea1d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.764554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c349a3f0-c93e-4112-8040-b05f1f6eea1d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.765332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c349a3f0-c93e-4112-8040-b05f1f6eea1d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.765826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c349a3f0-c93e-4112-8040-b05f1f6eea1d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.823463 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34870cbf-36ad-4c4b-b4d7-1d14e32d7fc7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:16.824074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34870cbf-36ad-4c4b-b4d7-1d14e32d7fc7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:16.830959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34870cbf-36ad-4c4b-b4d7-1d14e32d7fc7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.831410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34870cbf-36ad-4c4b-b4d7-1d14e32d7fc7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.832184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34870cbf-36ad-4c4b-b4d7-1d14e32d7fc7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.832955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34870cbf-36ad-4c4b-b4d7-1d14e32d7fc7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.946724 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c349a3f0-c93e-4112-8040-b05f1f6eea1d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.954727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c349a3f0-c93e-4112-8040-b05f1f6eea1d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.202710 May 26 12:48:16.955655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 66/137] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:16 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:16.997886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34870cbf-36ad-4c4b-b4d7-1d14e32d7fc7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.006120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34870cbf-36ad-4c4b-b4d7-1d14e32d7fc7 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.185731 May 26 12:48:17.007124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 72/138] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:16 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:17.440996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0fe15245-56b1-4207-8f13-0fa2e9307c52 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:17.441790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0fe15245-56b1-4207-8f13-0fa2e9307c52 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:17.450123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fe15245-56b1-4207-8f13-0fa2e9307c52 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.450823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fe15245-56b1-4207-8f13-0fa2e9307c52 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.451815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fe15245-56b1-4207-8f13-0fa2e9307c52 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.452323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fe15245-56b1-4207-8f13-0fa2e9307c52 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.474353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:17.610188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0fe15245-56b1-4207-8f13-0fa2e9307c52 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.620131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0fe15245-56b1-4207-8f13-0fa2e9307c52 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.182758 May 26 12:48:17.629415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 67/139] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:17 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:17.972214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23a06a3e-3046-44c3-a4b4-3882995d02b2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:17.973533 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23a06a3e-3046-44c3-a4b4-3882995d02b2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:17.986755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23a06a3e-3046-44c3-a4b4-3882995d02b2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.987292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23a06a3e-3046-44c3-a4b4-3882995d02b2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.988782 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23a06a3e-3046-44c3-a4b4-3882995d02b2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.989249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23a06a3e-3046-44c3-a4b4-3882995d02b2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.023263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-59c54ff5-ab58-4a31-b3f4-0a1876577966 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:18.023884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-59c54ff5-ab58-4a31-b3f4-0a1876577966 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:18.030660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59c54ff5-ab58-4a31-b3f4-0a1876577966 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.031287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59c54ff5-ab58-4a31-b3f4-0a1876577966 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.032331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59c54ff5-ab58-4a31-b3f4-0a1876577966 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.032774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59c54ff5-ab58-4a31-b3f4-0a1876577966 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.187783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23a06a3e-3046-44c3-a4b4-3882995d02b2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:18.214153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23a06a3e-3046-44c3-a4b4-3882995d02b2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.246035 May 26 12:48:18.216065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 73/140] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:17 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:18.287736 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-59c54ff5-ab58-4a31-b3f4-0a1876577966 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:18.299991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-59c54ff5-ab58-4a31-b3f4-0a1876577966 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1314 microversion: 2.1 time: 0.279333 May 26 12:48:18.302240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 68/141] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:18 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:18.637440 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-40c36029-0fc0-42b7-b0d0-073aab20fe7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:18.638198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-40c36029-0fc0-42b7-b0d0-073aab20fe7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:18.644869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40c36029-0fc0-42b7-b0d0-073aab20fe7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.645411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40c36029-0fc0-42b7-b0d0-073aab20fe7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.646905 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40c36029-0fc0-42b7-b0d0-073aab20fe7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.647345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40c36029-0fc0-42b7-b0d0-073aab20fe7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.788863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40c36029-0fc0-42b7-b0d0-073aab20fe7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:18.797864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-40c36029-0fc0-42b7-b0d0-073aab20fe7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.164191 May 26 12:48:18.808741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 74/142] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:18 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:19.237873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-811c3cb5-88b4-4e18-83c6-663bb7e157c4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:19.239539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-811c3cb5-88b4-4e18-83c6-663bb7e157c4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:19.246221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-811c3cb5-88b4-4e18-83c6-663bb7e157c4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:19.246603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-811c3cb5-88b4-4e18-83c6-663bb7e157c4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.252511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-811c3cb5-88b4-4e18-83c6-663bb7e157c4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:19.252511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-811c3cb5-88b4-4e18-83c6-663bb7e157c4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.320763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-17a147cd-de4a-4df7-b325-40245d3523f4 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:19.321388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-17a147cd-de4a-4df7-b325-40245d3523f4 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:19.327948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17a147cd-de4a-4df7-b325-40245d3523f4 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:19.328414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17a147cd-de4a-4df7-b325-40245d3523f4 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.329250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17a147cd-de4a-4df7-b325-40245d3523f4 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:19.329644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17a147cd-de4a-4df7-b325-40245d3523f4 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.435444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-811c3cb5-88b4-4e18-83c6-663bb7e157c4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.442946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-811c3cb5-88b4-4e18-83c6-663bb7e157c4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.208801 May 26 12:48:19.443611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 69/143] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:19 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:19.498158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-17a147cd-de4a-4df7-b325-40245d3523f4 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.506358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-17a147cd-de4a-4df7-b325-40245d3523f4 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1502 microversion: 2.1 time: 0.192865 May 26 12:48:19.506988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 75/144] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:19 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:19.816669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-34a245d1-5982-43d1-b419-c83e031b1fd6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:19.818155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-34a245d1-5982-43d1-b419-c83e031b1fd6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:19.826040 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34a245d1-5982-43d1-b419-c83e031b1fd6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:19.826549 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34a245d1-5982-43d1-b419-c83e031b1fd6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.828024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34a245d1-5982-43d1-b419-c83e031b1fd6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:19.828735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34a245d1-5982-43d1-b419-c83e031b1fd6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.986627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-34a245d1-5982-43d1-b419-c83e031b1fd6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.995951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-34a245d1-5982-43d1-b419-c83e031b1fd6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.184038 May 26 12:48:19.996686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 70/145] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:19 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:20.460922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d7b2900f-ca3c-42d5-861a-b599ecba3f99 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:20.461693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d7b2900f-ca3c-42d5-861a-b599ecba3f99 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:20.468054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7b2900f-ca3c-42d5-861a-b599ecba3f99 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:20.468626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7b2900f-ca3c-42d5-861a-b599ecba3f99 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:20.470169 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7b2900f-ca3c-42d5-861a-b599ecba3f99 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:20.470742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7b2900f-ca3c-42d5-861a-b599ecba3f99 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:20.486786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-bdc4c260-592b-4378-9b21-221c345ce634 req-36beb6f7-9b9d-4494-ab28-c5924b66cc90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9a6c21-74a0-432e-bcb3-c91e2c45fe15", "name": "network-vif-plugged", "status": "completed", "tag": "b7901f5b-84cd-435a-aac3-53e7b431a21f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:20.496704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-bdc4c260-592b-4378-9b21-221c345ce634 req-36beb6f7-9b9d-4494-ab28-c5924b66cc90 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:20.497160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-bdc4c260-592b-4378-9b21-221c345ce634 req-36beb6f7-9b9d-4494-ab28-c5924b66cc90 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:20.509817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-bdc4c260-592b-4378-9b21-221c345ce634 req-36beb6f7-9b9d-4494-ab28-c5924b66cc90 service nova] Creating event network-vif-plugged:b7901f5b-84cd-435a-aac3-53e7b431a21f for instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 on hv-cinder-81514 May 26 12:48:20.515812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-bdc4c260-592b-4378-9b21-221c345ce634 req-36beb6f7-9b9d-4494-ab28-c5924b66cc90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032850 May 26 12:48:20.516502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 71/146] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:20.688707 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d7b2900f-ca3c-42d5-861a-b599ecba3f99 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:20.701714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d7b2900f-ca3c-42d5-861a-b599ecba3f99 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.241446 May 26 12:48:20.701714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 76/147] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:20 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:21.013820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7584c45a-8e0a-4d46-b6f7-de9df2be35c5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:21.014550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7584c45a-8e0a-4d46-b6f7-de9df2be35c5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:21.022264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7584c45a-8e0a-4d46-b6f7-de9df2be35c5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.022762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7584c45a-8e0a-4d46-b6f7-de9df2be35c5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.023543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7584c45a-8e0a-4d46-b6f7-de9df2be35c5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.023988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7584c45a-8e0a-4d46-b6f7-de9df2be35c5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.240446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7584c45a-8e0a-4d46-b6f7-de9df2be35c5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.253985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7584c45a-8e0a-4d46-b6f7-de9df2be35c5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.244083 May 26 12:48:21.264532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 72/148] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:21 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:21.719839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7d0e038b-992a-4ae0-a988-52f885120486 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:21.720965 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7d0e038b-992a-4ae0-a988-52f885120486 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:21.728399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d0e038b-992a-4ae0-a988-52f885120486 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.729137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d0e038b-992a-4ae0-a988-52f885120486 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.731464 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d0e038b-992a-4ae0-a988-52f885120486 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.744573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d0e038b-992a-4ae0-a988-52f885120486 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.879390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7d0e038b-992a-4ae0-a988-52f885120486 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.888329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7d0e038b-992a-4ae0-a988-52f885120486 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.173616 May 26 12:48:21.888834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 77/149] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:21 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:22.271071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f23ccd4a-6b90-4bb9-990e-29cbd0bd5fb6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:22.271754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f23ccd4a-6b90-4bb9-990e-29cbd0bd5fb6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:22.278273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f23ccd4a-6b90-4bb9-990e-29cbd0bd5fb6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.278874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f23ccd4a-6b90-4bb9-990e-29cbd0bd5fb6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.279727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f23ccd4a-6b90-4bb9-990e-29cbd0bd5fb6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.280174 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f23ccd4a-6b90-4bb9-990e-29cbd0bd5fb6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.413602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f23ccd4a-6b90-4bb9-990e-29cbd0bd5fb6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:22.421519 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f23ccd4a-6b90-4bb9-990e-29cbd0bd5fb6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.154278 May 26 12:48:22.422107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 73/150] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:22 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:22.717831 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3a8e70f-fcde-4efd-9003-2d18cce28965 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7b374fa-1883-425c-9570-f54df8e3c942"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:22.719565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3a8e70f-fcde-4efd-9003-2d18cce28965 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:22.727084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3a8e70f-fcde-4efd-9003-2d18cce28965 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.728312 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3a8e70f-fcde-4efd-9003-2d18cce28965 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.729347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3a8e70f-fcde-4efd-9003-2d18cce28965 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.730042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3a8e70f-fcde-4efd-9003-2d18cce28965 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.906141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6077734b-135a-4c9b-aa3c-63eb0659da11 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:22.907081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6077734b-135a-4c9b-aa3c-63eb0659da11 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:22.914795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6077734b-135a-4c9b-aa3c-63eb0659da11 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.915609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6077734b-135a-4c9b-aa3c-63eb0659da11 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.916600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6077734b-135a-4c9b-aa3c-63eb0659da11 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.917120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6077734b-135a-4c9b-aa3c-63eb0659da11 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:23.061028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6077734b-135a-4c9b-aa3c-63eb0659da11 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.071016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6077734b-135a-4c9b-aa3c-63eb0659da11 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.168473 May 26 12:48:23.090130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 74/151] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:22 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:23.215355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:23.441411 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b38fb00e-f5a8-4e4d-b47e-8aa24bc05925 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:23.442123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b38fb00e-f5a8-4e4d-b47e-8aa24bc05925 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:23.448225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b38fb00e-f5a8-4e4d-b47e-8aa24bc05925 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:23.448684 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b38fb00e-f5a8-4e4d-b47e-8aa24bc05925 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:23.449468 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b38fb00e-f5a8-4e4d-b47e-8aa24bc05925 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:23.449914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b38fb00e-f5a8-4e4d-b47e-8aa24bc05925 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:23.614501 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b38fb00e-f5a8-4e4d-b47e-8aa24bc05925 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.623333 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b38fb00e-f5a8-4e4d-b47e-8aa24bc05925 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.185691 May 26 12:48:23.624098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 75/152] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:23 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:24.088494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f89d089-b339-4f17-b2c1-880aea646958 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:24.089143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f89d089-b339-4f17-b2c1-880aea646958 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:24.096659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f89d089-b339-4f17-b2c1-880aea646958 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.097113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f89d089-b339-4f17-b2c1-880aea646958 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.098190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f89d089-b339-4f17-b2c1-880aea646958 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.098665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f89d089-b339-4f17-b2c1-880aea646958 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.287569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4f89d089-b339-4f17-b2c1-880aea646958 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:24.300430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f89d089-b339-4f17-b2c1-880aea646958 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.216158 May 26 12:48:24.301284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 76/153] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:24 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:24.642088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c715809e-a227-4348-8e23-1b42f9406944 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:24.642745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c715809e-a227-4348-8e23-1b42f9406944 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:24.651848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c715809e-a227-4348-8e23-1b42f9406944 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.652631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c715809e-a227-4348-8e23-1b42f9406944 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.653956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c715809e-a227-4348-8e23-1b42f9406944 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.654811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c715809e-a227-4348-8e23-1b42f9406944 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.076096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c715809e-a227-4348-8e23-1b42f9406944 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.089612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c715809e-a227-4348-8e23-1b42f9406944 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.451117 May 26 12:48:25.090859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 77/154] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:24 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:25.317501 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f9dbba51-987b-47af-9ff1-3e366c6730d3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:25.318696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f9dbba51-987b-47af-9ff1-3e366c6730d3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:25.324939 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9dbba51-987b-47af-9ff1-3e366c6730d3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:25.325391 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9dbba51-987b-47af-9ff1-3e366c6730d3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.326201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9dbba51-987b-47af-9ff1-3e366c6730d3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:25.326678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9dbba51-987b-47af-9ff1-3e366c6730d3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.550804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f9dbba51-987b-47af-9ff1-3e366c6730d3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.560650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f9dbba51-987b-47af-9ff1-3e366c6730d3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.246863 May 26 12:48:25.561883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 78/155] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:25 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:26.107739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4def02c2-543b-41a8-ad49-99ea39d6e7e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:26.109360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4def02c2-543b-41a8-ad49-99ea39d6e7e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:26.118159 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4def02c2-543b-41a8-ad49-99ea39d6e7e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.121629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4def02c2-543b-41a8-ad49-99ea39d6e7e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.121629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4def02c2-543b-41a8-ad49-99ea39d6e7e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.121629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4def02c2-543b-41a8-ad49-99ea39d6e7e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.307060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4def02c2-543b-41a8-ad49-99ea39d6e7e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.316932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4def02c2-543b-41a8-ad49-99ea39d6e7e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.212956 May 26 12:48:26.317688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 79/156] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:26 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:26.578936 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2380f852-c8cf-4159-88c9-243c3cd66fb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:26.579557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2380f852-c8cf-4159-88c9-243c3cd66fb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:26.586818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2380f852-c8cf-4159-88c9-243c3cd66fb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.587330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2380f852-c8cf-4159-88c9-243c3cd66fb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.588579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2380f852-c8cf-4159-88c9-243c3cd66fb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.589023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2380f852-c8cf-4159-88c9-243c3cd66fb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.784340 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2380f852-c8cf-4159-88c9-243c3cd66fb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.793525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2380f852-c8cf-4159-88c9-243c3cd66fb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.218567 May 26 12:48:26.794099 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 80/157] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:26 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:27.339150 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c836eb9d-f476-40c0-aebe-858a24f3d5d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:27.340044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c836eb9d-f476-40c0-aebe-858a24f3d5d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:27.347964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c836eb9d-f476-40c0-aebe-858a24f3d5d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.348470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c836eb9d-f476-40c0-aebe-858a24f3d5d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.349258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c836eb9d-f476-40c0-aebe-858a24f3d5d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.350425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c836eb9d-f476-40c0-aebe-858a24f3d5d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.518550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c836eb9d-f476-40c0-aebe-858a24f3d5d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:27.526873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c836eb9d-f476-40c0-aebe-858a24f3d5d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.191477 May 26 12:48:27.527448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 81/158] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:27 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:27.815295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c9c02ec-d955-456c-a9e0-de66c8795a2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:27.815942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c9c02ec-d955-456c-a9e0-de66c8795a2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:27.826088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c9c02ec-d955-456c-a9e0-de66c8795a2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.826804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c9c02ec-d955-456c-a9e0-de66c8795a2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.827739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c9c02ec-d955-456c-a9e0-de66c8795a2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.828351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c9c02ec-d955-456c-a9e0-de66c8795a2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.998355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c9c02ec-d955-456c-a9e0-de66c8795a2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.017755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c9c02ec-d955-456c-a9e0-de66c8795a2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.209896 May 26 12:48:28.028773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 82/159] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:27 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:28.543368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c864359a-fe7c-4801-9c79-01e66c45c072 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:28.544877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c864359a-fe7c-4801-9c79-01e66c45c072 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:28.551454 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c864359a-fe7c-4801-9c79-01e66c45c072 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.552083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c864359a-fe7c-4801-9c79-01e66c45c072 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.553067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c864359a-fe7c-4801-9c79-01e66c45c072 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.553726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c864359a-fe7c-4801-9c79-01e66c45c072 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.704667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c864359a-fe7c-4801-9c79-01e66c45c072 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.716603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c864359a-fe7c-4801-9c79-01e66c45c072 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1366 microversion: 2.1 time: 0.176854 May 26 12:48:28.717578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 83/160] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:28 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:28.987737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-22462233-d66a-4621-b8d6-a25bc717bb5a req-881788a3-f726-4cd1-9817-fcb1ce602353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0427d82f-3f18-4102-963b-6eab4c3a7bd5", "name": "network-vif-plugged", "status": "completed", "tag": "efe1db4b-2d32-49d2-9494-afad4976ae83"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:28.996666 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-22462233-d66a-4621-b8d6-a25bc717bb5a req-881788a3-f726-4cd1-9817-fcb1ce602353 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.997128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-22462233-d66a-4621-b8d6-a25bc717bb5a req-881788a3-f726-4cd1-9817-fcb1ce602353 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.010275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-22462233-d66a-4621-b8d6-a25bc717bb5a req-881788a3-f726-4cd1-9817-fcb1ce602353 service nova] Creating event network-vif-plugged:efe1db4b-2d32-49d2-9494-afad4976ae83 for instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 on hv-cinder-81514 May 26 12:48:29.016085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-22462233-d66a-4621-b8d6-a25bc717bb5a req-881788a3-f726-4cd1-9817-fcb1ce602353 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032050 May 26 12:48:29.016684 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 84/161] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:29.036068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85f06fe1-0c99-4f48-b3ee-bcb192c439ab tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:29.037765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85f06fe1-0c99-4f48-b3ee-bcb192c439ab tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:29.044212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f06fe1-0c99-4f48-b3ee-bcb192c439ab tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.044667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f06fe1-0c99-4f48-b3ee-bcb192c439ab tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.045462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f06fe1-0c99-4f48-b3ee-bcb192c439ab tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.045978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f06fe1-0c99-4f48-b3ee-bcb192c439ab tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.064899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:29.189454 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85f06fe1-0c99-4f48-b3ee-bcb192c439ab tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.199226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85f06fe1-0c99-4f48-b3ee-bcb192c439ab tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.167827 May 26 12:48:29.213393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 85/162] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:29 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:29.734102 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f67567dc-9039-425c-8041-a7fc77c62622 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:29.734780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f67567dc-9039-425c-8041-a7fc77c62622 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:29.742606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f67567dc-9039-425c-8041-a7fc77c62622 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.743066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f67567dc-9039-425c-8041-a7fc77c62622 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.743846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f67567dc-9039-425c-8041-a7fc77c62622 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.744286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f67567dc-9039-425c-8041-a7fc77c62622 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.920717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f67567dc-9039-425c-8041-a7fc77c62622 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.927477 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f67567dc-9039-425c-8041-a7fc77c62622 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1557 microversion: 2.1 time: 0.198070 May 26 12:48:29.940881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 86/163] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:29 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:29.946483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-066d19a4-ba9a-424f-886e-62c4f93009c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:29.947425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-066d19a4-ba9a-424f-886e-62c4f93009c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:29.954562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-066d19a4-ba9a-424f-886e-62c4f93009c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.955062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-066d19a4-ba9a-424f-886e-62c4f93009c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.955843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-066d19a4-ba9a-424f-886e-62c4f93009c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.956615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-066d19a4-ba9a-424f-886e-62c4f93009c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.139070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-066d19a4-ba9a-424f-886e-62c4f93009c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196795 May 26 12:48:30.140077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 87/164] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 26 12:48:29 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:30.215651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aca26820-fa73-4190-95db-56e6c5a5b242 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:30.216663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aca26820-fa73-4190-95db-56e6c5a5b242 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:30.223419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aca26820-fa73-4190-95db-56e6c5a5b242 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.223873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aca26820-fa73-4190-95db-56e6c5a5b242 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.224716 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aca26820-fa73-4190-95db-56e6c5a5b242 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.225277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aca26820-fa73-4190-95db-56e6c5a5b242 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.656813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aca26820-fa73-4190-95db-56e6c5a5b242 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:30.672067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aca26820-fa73-4190-95db-56e6c5a5b242 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.455760 May 26 12:48:30.675534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 88/165] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:30 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:31.687114 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b3de5fc-fae0-414d-bb6c-9b4c283bf563 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:31.688451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b3de5fc-fae0-414d-bb6c-9b4c283bf563 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:31.703067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b3de5fc-fae0-414d-bb6c-9b4c283bf563 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:31.704266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b3de5fc-fae0-414d-bb6c-9b4c283bf563 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.714438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b3de5fc-fae0-414d-bb6c-9b4c283bf563 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:31.714438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b3de5fc-fae0-414d-bb6c-9b4c283bf563 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.957441 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b3de5fc-fae0-414d-bb6c-9b4c283bf563 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.972823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b3de5fc-fae0-414d-bb6c-9b4c283bf563 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.286369 May 26 12:48:31.972823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 89/166] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:31 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:32.203353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c6f37563-96c1-4383-9c97-58d73376864e req-90e09a96-5da8-47ce-a89c-1ee3e7c6bd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9a6c21-74a0-432e-bcb3-c91e2c45fe15", "tag": "b7901f5b-84cd-435a-aac3-53e7b431a21f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:32.212761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c6f37563-96c1-4383-9c97-58d73376864e req-90e09a96-5da8-47ce-a89c-1ee3e7c6bd4f service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.213519 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c6f37563-96c1-4383-9c97-58d73376864e req-90e09a96-5da8-47ce-a89c-1ee3e7c6bd4f service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.234399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c6f37563-96c1-4383-9c97-58d73376864e req-90e09a96-5da8-47ce-a89c-1ee3e7c6bd4f service nova] Creating event network-changed:b7901f5b-84cd-435a-aac3-53e7b431a21f for instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 on hv-cinder-81514 May 26 12:48:32.246246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-c6f37563-96c1-4383-9c97-58d73376864e req-90e09a96-5da8-47ce-a89c-1ee3e7c6bd4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051245 May 26 12:48:32.250930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 90/167] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:32.727082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=56 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:32.861060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:32.991246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e2412f5-b780-48c5-b5ef-b031c1405f6c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:32.992064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e2412f5-b780-48c5-b5ef-b031c1405f6c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:32.998886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e2412f5-b780-48c5-b5ef-b031c1405f6c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.009757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e2412f5-b780-48c5-b5ef-b031c1405f6c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.009757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e2412f5-b780-48c5-b5ef-b031c1405f6c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.009757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e2412f5-b780-48c5-b5ef-b031c1405f6c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.157564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e2412f5-b780-48c5-b5ef-b031c1405f6c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:33.168262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e2412f5-b780-48c5-b5ef-b031c1405f6c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.184171 May 26 12:48:33.179549 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 91/168] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:32 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:34.197004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-88c35a47-8486-4ad7-adbc-9b3557910a97 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:34.197716 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-88c35a47-8486-4ad7-adbc-9b3557910a97 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:34.203695 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88c35a47-8486-4ad7-adbc-9b3557910a97 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.204167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88c35a47-8486-4ad7-adbc-9b3557910a97 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.204914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88c35a47-8486-4ad7-adbc-9b3557910a97 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.205347 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88c35a47-8486-4ad7-adbc-9b3557910a97 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.346365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-88c35a47-8486-4ad7-adbc-9b3557910a97 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.355711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-88c35a47-8486-4ad7-adbc-9b3557910a97 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.162987 May 26 12:48:34.359721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 92/169] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:34 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:34.670741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3a8e70f-fcde-4efd-9003-2d18cce28965 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "POST /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.957343 May 26 12:48:34.671441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 78/170] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:48:22 2022] POST /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa/os-volume_attachments => generated 194 bytes in 11959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:35.372955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f40a5282-dc47-49c5-abe0-84c7eeca1f0e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:35.373567 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f40a5282-dc47-49c5-abe0-84c7eeca1f0e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:35.380119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f40a5282-dc47-49c5-abe0-84c7eeca1f0e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.381401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f40a5282-dc47-49c5-abe0-84c7eeca1f0e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.381401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f40a5282-dc47-49c5-abe0-84c7eeca1f0e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.381757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f40a5282-dc47-49c5-abe0-84c7eeca1f0e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.534020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f40a5282-dc47-49c5-abe0-84c7eeca1f0e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.550204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f40a5282-dc47-49c5-abe0-84c7eeca1f0e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.180782 May 26 12:48:35.551236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 93/171] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:35 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:36.575970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-42671d84-a08d-423c-96db-bd6c291d80e3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:36.576871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-42671d84-a08d-423c-96db-bd6c291d80e3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:36.583695 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42671d84-a08d-423c-96db-bd6c291d80e3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.584327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42671d84-a08d-423c-96db-bd6c291d80e3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.585203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42671d84-a08d-423c-96db-bd6c291d80e3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.585648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42671d84-a08d-423c-96db-bd6c291d80e3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.728159 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-42671d84-a08d-423c-96db-bd6c291d80e3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:36.736610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-42671d84-a08d-423c-96db-bd6c291d80e3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1321 microversion: 2.1 time: 0.165297 May 26 12:48:36.737181 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 79/172] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:36 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:37.758870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-325a76b3-abb3-4457-8f6b-07c513101884 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:37.760788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-325a76b3-abb3-4457-8f6b-07c513101884 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:37.772851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-325a76b3-abb3-4457-8f6b-07c513101884 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.773961 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-325a76b3-abb3-4457-8f6b-07c513101884 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.775206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-325a76b3-abb3-4457-8f6b-07c513101884 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.775945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-325a76b3-abb3-4457-8f6b-07c513101884 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.944367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-325a76b3-abb3-4457-8f6b-07c513101884 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.959654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-325a76b3-abb3-4457-8f6b-07c513101884 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1516 microversion: 2.1 time: 0.206435 May 26 12:48:37.960809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 94/173] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:37 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:37.977903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-acf71f6d-9f78-47f1-991c-781731c827aa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:37.980261 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-acf71f6d-9f78-47f1-991c-781731c827aa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:37.987605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acf71f6d-9f78-47f1-991c-781731c827aa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.988391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acf71f6d-9f78-47f1-991c-781731c827aa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.989369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acf71f6d-9f78-47f1-991c-781731c827aa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.990005 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acf71f6d-9f78-47f1-991c-781731c827aa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.165468 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-acf71f6d-9f78-47f1-991c-781731c827aa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lazy-loading 'flavor' on Instance uuid 0427d82f-3f18-4102-963b-6eab4c3a7bd5 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:48:38.687702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-acf71f6d-9f78-47f1-991c-781731c827aa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5/action" status: 200 len: 32 microversion: 2.1 time: 0.714264 May 26 12:48:38.689740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 80/174] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:48:37 2022] POST /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5/action => generated 32 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:48:38.702927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0deca578-3e00-488f-8f91-287e5ca27eb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:38.703897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0deca578-3e00-488f-8f91-287e5ca27eb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:38.711125 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0deca578-3e00-488f-8f91-287e5ca27eb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.711784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0deca578-3e00-488f-8f91-287e5ca27eb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.712710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0deca578-3e00-488f-8f91-287e5ca27eb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.713305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0deca578-3e00-488f-8f91-287e5ca27eb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.883803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0deca578-3e00-488f-8f91-287e5ca27eb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:38.894994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0deca578-3e00-488f-8f91-287e5ca27eb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.195685 May 26 12:48:38.895673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 95/175] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:38 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:39.916361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1a3c1b13-8c64-47c0-b4ee-967eb70b5595 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:39.918234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1a3c1b13-8c64-47c0-b4ee-967eb70b5595 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:39.927473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a3c1b13-8c64-47c0-b4ee-967eb70b5595 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.928665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a3c1b13-8c64-47c0-b4ee-967eb70b5595 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.930108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a3c1b13-8c64-47c0-b4ee-967eb70b5595 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.930776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a3c1b13-8c64-47c0-b4ee-967eb70b5595 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.104447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a3c1b13-8c64-47c0-b4ee-967eb70b5595 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:40.113226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1a3c1b13-8c64-47c0-b4ee-967eb70b5595 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.203418 May 26 12:48:40.113823 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 81/176] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:39 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:41.132364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc474752-4dde-4428-a292-3e431b2d2de2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:41.133534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc474752-4dde-4428-a292-3e431b2d2de2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:41.136360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=92 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:41.142775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc474752-4dde-4428-a292-3e431b2d2de2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.143478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc474752-4dde-4428-a292-3e431b2d2de2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.144446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc474752-4dde-4428-a292-3e431b2d2de2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.145081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc474752-4dde-4428-a292-3e431b2d2de2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.336238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc474752-4dde-4428-a292-3e431b2d2de2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:41.344271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc474752-4dde-4428-a292-3e431b2d2de2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.216837 May 26 12:48:41.344854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 96/177] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:41 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:42.364033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7acaa399-d42c-4daf-8ad5-26fb25e9bc86 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:42.364658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7acaa399-d42c-4daf-8ad5-26fb25e9bc86 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:42.373426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7acaa399-d42c-4daf-8ad5-26fb25e9bc86 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:42.374139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7acaa399-d42c-4daf-8ad5-26fb25e9bc86 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:42.375133 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7acaa399-d42c-4daf-8ad5-26fb25e9bc86 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:42.375765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7acaa399-d42c-4daf-8ad5-26fb25e9bc86 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:42.550563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7acaa399-d42c-4daf-8ad5-26fb25e9bc86 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.559990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7acaa399-d42c-4daf-8ad5-26fb25e9bc86 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.199864 May 26 12:48:42.572669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 82/178] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:42 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:43.579117 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d9e3781-6fcd-4b78-9ece-aa326386a805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:43.580322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d9e3781-6fcd-4b78-9ece-aa326386a805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:43.587496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d9e3781-6fcd-4b78-9ece-aa326386a805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.587958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d9e3781-6fcd-4b78-9ece-aa326386a805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.588743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d9e3781-6fcd-4b78-9ece-aa326386a805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.589181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d9e3781-6fcd-4b78-9ece-aa326386a805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.747353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d9e3781-6fcd-4b78-9ece-aa326386a805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:43.759214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d9e3781-6fcd-4b78-9ece-aa326386a805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.186248 May 26 12:48:43.760001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 97/179] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:43 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:44.777485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f53bf38c-91f0-42e0-8412-782867ca2ad9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:44.778784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f53bf38c-91f0-42e0-8412-782867ca2ad9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:44.785712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53bf38c-91f0-42e0-8412-782867ca2ad9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:44.786169 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53bf38c-91f0-42e0-8412-782867ca2ad9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:44.786978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53bf38c-91f0-42e0-8412-782867ca2ad9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:44.787875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53bf38c-91f0-42e0-8412-782867ca2ad9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:44.962887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f53bf38c-91f0-42e0-8412-782867ca2ad9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:44.970903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f53bf38c-91f0-42e0-8412-782867ca2ad9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.197355 May 26 12:48:44.971694 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 83/180] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:44 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:45.987221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-21424c72-f491-48f6-8a48-fdd80cd9d6ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:45.987833 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-21424c72-f491-48f6-8a48-fdd80cd9d6ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:45.994567 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21424c72-f491-48f6-8a48-fdd80cd9d6ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:45.995012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21424c72-f491-48f6-8a48-fdd80cd9d6ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:45.995920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21424c72-f491-48f6-8a48-fdd80cd9d6ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:45.996353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21424c72-f491-48f6-8a48-fdd80cd9d6ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:46.129422 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-21424c72-f491-48f6-8a48-fdd80cd9d6ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:46.138367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-21424c72-f491-48f6-8a48-fdd80cd9d6ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.155024 May 26 12:48:46.139003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 98/181] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:45 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:47.156962 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-85a03d37-2e3e-43d6-bebd-838a19db1e18 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:47.157664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-85a03d37-2e3e-43d6-bebd-838a19db1e18 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:47.166368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85a03d37-2e3e-43d6-bebd-838a19db1e18 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:47.166368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85a03d37-2e3e-43d6-bebd-838a19db1e18 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:47.166675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85a03d37-2e3e-43d6-bebd-838a19db1e18 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:47.166959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85a03d37-2e3e-43d6-bebd-838a19db1e18 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:47.378232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85a03d37-2e3e-43d6-bebd-838a19db1e18 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:47.387383 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-85a03d37-2e3e-43d6-bebd-838a19db1e18 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.234307 May 26 12:48:47.388218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 84/182] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:47 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:48.407537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3897e8fa-6435-451b-8b1a-7ddb4062b820 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:48.408816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3897e8fa-6435-451b-8b1a-7ddb4062b820 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:48.416317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3897e8fa-6435-451b-8b1a-7ddb4062b820 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:48.417001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3897e8fa-6435-451b-8b1a-7ddb4062b820 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.417927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3897e8fa-6435-451b-8b1a-7ddb4062b820 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:48.418764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3897e8fa-6435-451b-8b1a-7ddb4062b820 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.581955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3897e8fa-6435-451b-8b1a-7ddb4062b820 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:48.590671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3897e8fa-6435-451b-8b1a-7ddb4062b820 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.188508 May 26 12:48:48.591457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 99/183] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:48 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:49.609073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5418e807-893f-440a-9eac-4139142f1ac2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:49.609822 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5418e807-893f-440a-9eac-4139142f1ac2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:49.617142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5418e807-893f-440a-9eac-4139142f1ac2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.617601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5418e807-893f-440a-9eac-4139142f1ac2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.618391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5418e807-893f-440a-9eac-4139142f1ac2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.618870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5418e807-893f-440a-9eac-4139142f1ac2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.773997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5418e807-893f-440a-9eac-4139142f1ac2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:49.793787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5418e807-893f-440a-9eac-4139142f1ac2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.188185 May 26 12:48:49.797608 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 85/184] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:49 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:50.814265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a03797b-c64c-4800-a766-77146b9da69c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:50.814801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a03797b-c64c-4800-a766-77146b9da69c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:50.821743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a03797b-c64c-4800-a766-77146b9da69c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:50.821917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a03797b-c64c-4800-a766-77146b9da69c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:50.822739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a03797b-c64c-4800-a766-77146b9da69c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:50.823170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a03797b-c64c-4800-a766-77146b9da69c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:50.957689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a03797b-c64c-4800-a766-77146b9da69c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:50.965603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a03797b-c64c-4800-a766-77146b9da69c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.156023 May 26 12:48:50.966103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 100/185] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:50 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:51.983443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2908894e-4733-432f-b24a-5ec79134b404 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:51.984055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2908894e-4733-432f-b24a-5ec79134b404 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:51.990851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2908894e-4733-432f-b24a-5ec79134b404 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:51.991227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2908894e-4733-432f-b24a-5ec79134b404 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:51.991998 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2908894e-4733-432f-b24a-5ec79134b404 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:51.992436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2908894e-4733-432f-b24a-5ec79134b404 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:52.139945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2908894e-4733-432f-b24a-5ec79134b404 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:52.147721 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2908894e-4733-432f-b24a-5ec79134b404 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.168101 May 26 12:48:52.148292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 86/186] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:51 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:53.169168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fcc28fda-ebed-4417-a425-d568efca82f6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:53.171004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fcc28fda-ebed-4417-a425-d568efca82f6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:53.181990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc28fda-ebed-4417-a425-d568efca82f6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:53.182807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc28fda-ebed-4417-a425-d568efca82f6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:53.184389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc28fda-ebed-4417-a425-d568efca82f6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:53.185024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc28fda-ebed-4417-a425-d568efca82f6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:53.326278 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcc28fda-ebed-4417-a425-d568efca82f6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:53.334027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fcc28fda-ebed-4417-a425-d568efca82f6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.172585 May 26 12:48:53.344703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 101/187] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:53 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:54.352995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf38ab6d-d882-4ce4-b32f-bec4a1bf491c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:54.353614 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf38ab6d-d882-4ce4-b32f-bec4a1bf491c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:54.360023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf38ab6d-d882-4ce4-b32f-bec4a1bf491c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:54.360472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf38ab6d-d882-4ce4-b32f-bec4a1bf491c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.361376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf38ab6d-d882-4ce4-b32f-bec4a1bf491c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:54.361724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf38ab6d-d882-4ce4-b32f-bec4a1bf491c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.502215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf38ab6d-d882-4ce4-b32f-bec4a1bf491c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:54.510658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf38ab6d-d882-4ce4-b32f-bec4a1bf491c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.162344 May 26 12:48:54.511226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 87/188] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:54 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:55.528431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fe3a74a0-acd1-40d2-8dfa-4db5a589e6af tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:55.529013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fe3a74a0-acd1-40d2-8dfa-4db5a589e6af tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:55.535089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe3a74a0-acd1-40d2-8dfa-4db5a589e6af tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:55.535547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe3a74a0-acd1-40d2-8dfa-4db5a589e6af tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:55.536319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe3a74a0-acd1-40d2-8dfa-4db5a589e6af tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:55.536761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe3a74a0-acd1-40d2-8dfa-4db5a589e6af tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:55.699881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe3a74a0-acd1-40d2-8dfa-4db5a589e6af tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:55.710933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fe3a74a0-acd1-40d2-8dfa-4db5a589e6af tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.186975 May 26 12:48:55.711885 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 102/189] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:55 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:56.215446 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6a7a1578-0075-4d51-b022-768a27425cef tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:56.216105 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6a7a1578-0075-4d51-b022-768a27425cef tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:56.222944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a7a1578-0075-4d51-b022-768a27425cef tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:56.223510 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a7a1578-0075-4d51-b022-768a27425cef tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:56.224335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a7a1578-0075-4d51-b022-768a27425cef tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:56.224850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a7a1578-0075-4d51-b022-768a27425cef tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:56.255601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6a7a1578-0075-4d51-b022-768a27425cef tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:48:56.729683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97aba3c0-651f-4f5e-a1ae-a2bf3ecac692 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:56.730436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97aba3c0-651f-4f5e-a1ae-a2bf3ecac692 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:56.736684 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97aba3c0-651f-4f5e-a1ae-a2bf3ecac692 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:56.737288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97aba3c0-651f-4f5e-a1ae-a2bf3ecac692 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:56.738071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97aba3c0-651f-4f5e-a1ae-a2bf3ecac692 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:56.738512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97aba3c0-651f-4f5e-a1ae-a2bf3ecac692 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:56.742598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:56.883488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6a7a1578-0075-4d51-b022-768a27425cef tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 204 len: 0 microversion: 2.1 time: 0.662702 May 26 12:48:56.883488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 88/190] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:48:56 2022] DELETE /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:48:56.884144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97aba3c0-651f-4f5e-a1ae-a2bf3ecac692 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:56.884144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97aba3c0-651f-4f5e-a1ae-a2bf3ecac692 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.158387 May 26 12:48:56.884310 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2cde4936-5899-4f18-ad22-3ef2cb0647c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:56.884310 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2cde4936-5899-4f18-ad22-3ef2cb0647c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:56.884805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 103/191] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:56 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:56.890453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cde4936-5899-4f18-ad22-3ef2cb0647c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:56.890938 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cde4936-5899-4f18-ad22-3ef2cb0647c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:56.891721 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cde4936-5899-4f18-ad22-3ef2cb0647c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:56.892149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cde4936-5899-4f18-ad22-3ef2cb0647c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:57.030619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2cde4936-5899-4f18-ad22-3ef2cb0647c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:57.038986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2cde4936-5899-4f18-ad22-3ef2cb0647c6 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1554 microversion: 2.1 time: 0.159616 May 26 12:48:57.040049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 89/192] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:56 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:57.902425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37d6ff6e-f9b1-4592-b49d-79f156de0149 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:57.903067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37d6ff6e-f9b1-4592-b49d-79f156de0149 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:57.909497 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d6ff6e-f9b1-4592-b49d-79f156de0149 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:57.909950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d6ff6e-f9b1-4592-b49d-79f156de0149 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:57.910756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d6ff6e-f9b1-4592-b49d-79f156de0149 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:57.911193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d6ff6e-f9b1-4592-b49d-79f156de0149 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.054245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37d6ff6e-f9b1-4592-b49d-79f156de0149 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:58.058910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2eb508c8-e153-4cd1-b0eb-61234a4b7f4a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:58.059810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2eb508c8-e153-4cd1-b0eb-61234a4b7f4a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:58.062951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37d6ff6e-f9b1-4592-b49d-79f156de0149 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.165534 May 26 12:48:58.063730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 104/193] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:57 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:58.069457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb508c8-e153-4cd1-b0eb-61234a4b7f4a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:58.069907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb508c8-e153-4cd1-b0eb-61234a4b7f4a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.070797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb508c8-e153-4cd1-b0eb-61234a4b7f4a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:58.071313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb508c8-e153-4cd1-b0eb-61234a4b7f4a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.091442 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:58.207912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2eb508c8-e153-4cd1-b0eb-61234a4b7f4a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:58.216760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2eb508c8-e153-4cd1-b0eb-61234a4b7f4a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1554 microversion: 2.1 time: 0.163313 May 26 12:48:58.217320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 90/194] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:58 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:59.087262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab00d1fc-af35-473d-8666-f72365b9fc73 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:59.087862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab00d1fc-af35-473d-8666-f72365b9fc73 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:59.093976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab00d1fc-af35-473d-8666-f72365b9fc73 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:59.094423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab00d1fc-af35-473d-8666-f72365b9fc73 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:59.095217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab00d1fc-af35-473d-8666-f72365b9fc73 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:59.095653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab00d1fc-af35-473d-8666-f72365b9fc73 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:59.231943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab00d1fc-af35-473d-8666-f72365b9fc73 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:59.234642 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7ccd9c2-c9f7-4236-a8ef-0e777e9a5b4b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:59.235269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7ccd9c2-c9f7-4236-a8ef-0e777e9a5b4b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:59.240185 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab00d1fc-af35-473d-8666-f72365b9fc73 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.156692 May 26 12:48:59.240762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 105/195] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:59 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:59.243596 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7ccd9c2-c9f7-4236-a8ef-0e777e9a5b4b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:59.244113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7ccd9c2-c9f7-4236-a8ef-0e777e9a5b4b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:59.244847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7ccd9c2-c9f7-4236-a8ef-0e777e9a5b4b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:59.245291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7ccd9c2-c9f7-4236-a8ef-0e777e9a5b4b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:59.392873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7ccd9c2-c9f7-4236-a8ef-0e777e9a5b4b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:59.401697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7ccd9c2-c9f7-4236-a8ef-0e777e9a5b4b tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1554 microversion: 2.1 time: 0.171110 May 26 12:48:59.402288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 91/196] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:48:59 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:00.259497 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31a31cdd-2784-4d2f-a964-6cc96a083bb8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:00.260108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31a31cdd-2784-4d2f-a964-6cc96a083bb8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:00.266241 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31a31cdd-2784-4d2f-a964-6cc96a083bb8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:00.266802 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31a31cdd-2784-4d2f-a964-6cc96a083bb8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:00.267575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31a31cdd-2784-4d2f-a964-6cc96a083bb8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:00.268013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31a31cdd-2784-4d2f-a964-6cc96a083bb8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:00.409653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-31a31cdd-2784-4d2f-a964-6cc96a083bb8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:00.418267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31a31cdd-2784-4d2f-a964-6cc96a083bb8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.163684 May 26 12:49:00.418902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 106/197] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:00 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:00.426982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f7f06b0-14d0-41d9-8446-782a9eab24f2 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:00.428139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f7f06b0-14d0-41d9-8446-782a9eab24f2 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:00.436743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7f06b0-14d0-41d9-8446-782a9eab24f2 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:00.437201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7f06b0-14d0-41d9-8446-782a9eab24f2 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:00.437980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7f06b0-14d0-41d9-8446-782a9eab24f2 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:00.438418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7f06b0-14d0-41d9-8446-782a9eab24f2 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:00.580139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f7f06b0-14d0-41d9-8446-782a9eab24f2 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:00.588228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f7f06b0-14d0-41d9-8446-782a9eab24f2 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1554 microversion: 2.1 time: 0.165064 May 26 12:49:00.588801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 92/198] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:00 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:01.436222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4fbb0cb0-017f-42fb-8c92-9dbb96b9a09b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:01.436672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4fbb0cb0-017f-42fb-8c92-9dbb96b9a09b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:01.442848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fbb0cb0-017f-42fb-8c92-9dbb96b9a09b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:01.443307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fbb0cb0-017f-42fb-8c92-9dbb96b9a09b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:01.444090 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fbb0cb0-017f-42fb-8c92-9dbb96b9a09b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:01.444533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fbb0cb0-017f-42fb-8c92-9dbb96b9a09b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:01.598826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4fbb0cb0-017f-42fb-8c92-9dbb96b9a09b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:01.605336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e39b9307-3197-419a-b222-d9b68063de0a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:01.605943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e39b9307-3197-419a-b222-d9b68063de0a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:01.606913 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4fbb0cb0-017f-42fb-8c92-9dbb96b9a09b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.174759 May 26 12:49:01.607665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 107/199] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:01 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:01.613094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e39b9307-3197-419a-b222-d9b68063de0a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:01.613665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e39b9307-3197-419a-b222-d9b68063de0a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:01.614483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e39b9307-3197-419a-b222-d9b68063de0a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:01.614976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e39b9307-3197-419a-b222-d9b68063de0a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:01.752548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e39b9307-3197-419a-b222-d9b68063de0a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:01.761490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e39b9307-3197-419a-b222-d9b68063de0a tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1554 microversion: 2.1 time: 0.160222 May 26 12:49:01.762092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 93/200] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:01 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:02.624298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f4941e97-4cd6-4017-a0b5-67143b65b2f0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:02.624914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f4941e97-4cd6-4017-a0b5-67143b65b2f0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:02.631091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4941e97-4cd6-4017-a0b5-67143b65b2f0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:02.631545 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4941e97-4cd6-4017-a0b5-67143b65b2f0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:02.632322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4941e97-4cd6-4017-a0b5-67143b65b2f0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:02.632760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4941e97-4cd6-4017-a0b5-67143b65b2f0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:02.771366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4941e97-4cd6-4017-a0b5-67143b65b2f0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:02.779725 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f4941e97-4cd6-4017-a0b5-67143b65b2f0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.159356 May 26 12:49:02.780311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 108/201] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:02 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:02.781155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8898ba5-1c0f-4d60-b458-6af55b7a2452 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:02.781780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8898ba5-1c0f-4d60-b458-6af55b7a2452 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:02.788696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8898ba5-1c0f-4d60-b458-6af55b7a2452 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:02.790740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8898ba5-1c0f-4d60-b458-6af55b7a2452 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:02.790740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8898ba5-1c0f-4d60-b458-6af55b7a2452 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:02.790740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8898ba5-1c0f-4d60-b458-6af55b7a2452 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:02.930146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8898ba5-1c0f-4d60-b458-6af55b7a2452 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:02.939086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8898ba5-1c0f-4d60-b458-6af55b7a2452 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1554 microversion: 2.1 time: 0.161753 May 26 12:49:02.939802 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 94/202] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:02 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:03.796865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4a6b6d18-23c0-4319-b193-7bebba594bba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:03.797517 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a6b6d18-23c0-4319-b193-7bebba594bba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:03.803884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a6b6d18-23c0-4319-b193-7bebba594bba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:03.804420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a6b6d18-23c0-4319-b193-7bebba594bba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:03.805218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a6b6d18-23c0-4319-b193-7bebba594bba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:03.805831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a6b6d18-23c0-4319-b193-7bebba594bba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:03.945016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4a6b6d18-23c0-4319-b193-7bebba594bba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:03.957641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23d17e33-30a5-4432-8697-50465c6bfc91 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:03.958212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4a6b6d18-23c0-4319-b193-7bebba594bba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.164932 May 26 12:49:03.959217 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23d17e33-30a5-4432-8697-50465c6bfc91 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:03.968014 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 109/203] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:03 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:03.970122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:03.970431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23d17e33-30a5-4432-8697-50465c6bfc91 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:03.970841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23d17e33-30a5-4432-8697-50465c6bfc91 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:03.971640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23d17e33-30a5-4432-8697-50465c6bfc91 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:03.972084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23d17e33-30a5-4432-8697-50465c6bfc91 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:04.124390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23d17e33-30a5-4432-8697-50465c6bfc91 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:04.133098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23d17e33-30a5-4432-8697-50465c6bfc91 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1554 microversion: 2.1 time: 0.179758 May 26 12:49:04.134802 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 95/204] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:03 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:04.975222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48116781-5cbd-45be-9892-38ee9f10f210 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:04.976493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-48116781-5cbd-45be-9892-38ee9f10f210 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:04.983625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48116781-5cbd-45be-9892-38ee9f10f210 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:04.984169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48116781-5cbd-45be-9892-38ee9f10f210 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:04.985028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48116781-5cbd-45be-9892-38ee9f10f210 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:04.985558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48116781-5cbd-45be-9892-38ee9f10f210 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:05.124455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-48116781-5cbd-45be-9892-38ee9f10f210 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:05.134693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48116781-5cbd-45be-9892-38ee9f10f210 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.163207 May 26 12:49:05.135658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 110/205] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:04 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:05.151712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c1771be-5667-49f9-b05d-fac2b96f7b17 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:05.153092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c1771be-5667-49f9-b05d-fac2b96f7b17 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:05.160816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c1771be-5667-49f9-b05d-fac2b96f7b17 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:05.161244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c1771be-5667-49f9-b05d-fac2b96f7b17 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:05.161981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c1771be-5667-49f9-b05d-fac2b96f7b17 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:05.162423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c1771be-5667-49f9-b05d-fac2b96f7b17 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:05.375570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c1771be-5667-49f9-b05d-fac2b96f7b17 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:05.383538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c1771be-5667-49f9-b05d-fac2b96f7b17 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1554 microversion: 2.1 time: 0.236359 May 26 12:49:05.387001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 96/206] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:05 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:05.582703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-8b02daff-75e9-4e0d-b790-7b783779c913 req-88f20e2d-7e05-4876-8dbb-72a7b0b72acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a00e0a-5352-49bb-bb1e-b77d70358cfa", "name": "network-vif-deleted", "tag": "dfcbc029-0888-4b38-8006-43ffa4bf81b4"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:05.591730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8b02daff-75e9-4e0d-b790-7b783779c913 req-88f20e2d-7e05-4876-8dbb-72a7b0b72acd service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:05.592181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8b02daff-75e9-4e0d-b790-7b783779c913 req-88f20e2d-7e05-4876-8dbb-72a7b0b72acd service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:05.604928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-8b02daff-75e9-4e0d-b790-7b783779c913 req-88f20e2d-7e05-4876-8dbb-72a7b0b72acd service nova] Creating event network-vif-deleted:dfcbc029-0888-4b38-8006-43ffa4bf81b4 for instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa on hv-cinder-81514 May 26 12:49:05.610302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-8b02daff-75e9-4e0d-b790-7b783779c913 req-88f20e2d-7e05-4876-8dbb-72a7b0b72acd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031412 May 26 12:49:05.612162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 111/207] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:06.152498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4d92e48d-e56d-4047-914c-123c2baeea83 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:06.153123 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4d92e48d-e56d-4047-914c-123c2baeea83 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:06.163852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d92e48d-e56d-4047-914c-123c2baeea83 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:06.163852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d92e48d-e56d-4047-914c-123c2baeea83 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:06.163852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d92e48d-e56d-4047-914c-123c2baeea83 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:06.163852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d92e48d-e56d-4047-914c-123c2baeea83 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:06.301904 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4d92e48d-e56d-4047-914c-123c2baeea83 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:06.310642 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4d92e48d-e56d-4047-914c-123c2baeea83 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.163112 May 26 12:49:06.311213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 97/208] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:06 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:06.401262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-daddd11b-dcf9-462b-868a-48c7586ba7c1 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:06.401964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-daddd11b-dcf9-462b-868a-48c7586ba7c1 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:06.408407 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-daddd11b-dcf9-462b-868a-48c7586ba7c1 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:06.408852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-daddd11b-dcf9-462b-868a-48c7586ba7c1 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:06.409620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-daddd11b-dcf9-462b-868a-48c7586ba7c1 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:06.410053 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-daddd11b-dcf9-462b-868a-48c7586ba7c1 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:06.475076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-daddd11b-dcf9-462b-868a-48c7586ba7c1 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:06.483885 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-daddd11b-dcf9-462b-868a-48c7586ba7c1 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1345 microversion: 2.1 time: 0.086835 May 26 12:49:06.484453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 112/209] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:06 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:07.328414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a042743-9324-48d1-a8d2-b60ba2fa88a2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:07.328969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a042743-9324-48d1-a8d2-b60ba2fa88a2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:07.335541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a042743-9324-48d1-a8d2-b60ba2fa88a2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:07.335995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a042743-9324-48d1-a8d2-b60ba2fa88a2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:07.336774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a042743-9324-48d1-a8d2-b60ba2fa88a2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:07.337919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a042743-9324-48d1-a8d2-b60ba2fa88a2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:07.470936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a042743-9324-48d1-a8d2-b60ba2fa88a2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:07.479037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a042743-9324-48d1-a8d2-b60ba2fa88a2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.154089 May 26 12:49:07.479144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 98/210] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:07 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:07.501497 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-53e4a8d8-07d0-44d2-b3a3-58800ff97131 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:07.502155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-53e4a8d8-07d0-44d2-b3a3-58800ff97131 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:07.512223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53e4a8d8-07d0-44d2-b3a3-58800ff97131 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:07.512677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53e4a8d8-07d0-44d2-b3a3-58800ff97131 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:07.513462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53e4a8d8-07d0-44d2-b3a3-58800ff97131 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:07.513904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53e4a8d8-07d0-44d2-b3a3-58800ff97131 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:07.576987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-53e4a8d8-07d0-44d2-b3a3-58800ff97131 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:07.587709 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-53e4a8d8-07d0-44d2-b3a3-58800ff97131 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1345 microversion: 2.1 time: 0.087361 May 26 12:49:07.587709 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 113/211] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:07 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:08.496224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aaf46533-fe7c-4165-b932-9a52ade97ee6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:08.496839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aaf46533-fe7c-4165-b932-9a52ade97ee6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:08.503379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaf46533-fe7c-4165-b932-9a52ade97ee6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:08.503836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaf46533-fe7c-4165-b932-9a52ade97ee6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:08.504608 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaf46533-fe7c-4165-b932-9a52ade97ee6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:08.505049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaf46533-fe7c-4165-b932-9a52ade97ee6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:08.603260 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-218cfac9-a502-435e-8e47-e3ffc78a7b9e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:08.603911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-218cfac9-a502-435e-8e47-e3ffc78a7b9e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:08.609948 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-218cfac9-a502-435e-8e47-e3ffc78a7b9e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:08.610400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-218cfac9-a502-435e-8e47-e3ffc78a7b9e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:08.611225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-218cfac9-a502-435e-8e47-e3ffc78a7b9e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:08.611661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-218cfac9-a502-435e-8e47-e3ffc78a7b9e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:08.640267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aaf46533-fe7c-4165-b932-9a52ade97ee6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:08.648550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aaf46533-fe7c-4165-b932-9a52ade97ee6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.156657 May 26 12:49:08.649451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 99/212] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:08 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:08.675827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-218cfac9-a502-435e-8e47-e3ffc78a7b9e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:08.684935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-218cfac9-a502-435e-8e47-e3ffc78a7b9e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1345 microversion: 2.1 time: 0.086019 May 26 12:49:08.685502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 114/213] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:08 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:09.672833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b4d61785-c3b4-407f-8811-65e90bf5df74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:09.673455 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b4d61785-c3b4-407f-8811-65e90bf5df74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:09.680221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4d61785-c3b4-407f-8811-65e90bf5df74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:09.680809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4d61785-c3b4-407f-8811-65e90bf5df74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:09.681799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4d61785-c3b4-407f-8811-65e90bf5df74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:09.682253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4d61785-c3b4-407f-8811-65e90bf5df74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:09.703529 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8d1d5d3-a440-4c94-af9c-95b20b1b292e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:09.704145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8d1d5d3-a440-4c94-af9c-95b20b1b292e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:09.717188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8d1d5d3-a440-4c94-af9c-95b20b1b292e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:09.717688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8d1d5d3-a440-4c94-af9c-95b20b1b292e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:09.719082 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8d1d5d3-a440-4c94-af9c-95b20b1b292e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:09.719534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8d1d5d3-a440-4c94-af9c-95b20b1b292e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:09.797670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f8d1d5d3-a440-4c94-af9c-95b20b1b292e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:09.810447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8d1d5d3-a440-4c94-af9c-95b20b1b292e tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1345 microversion: 2.1 time: 0.111801 May 26 12:49:09.822906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 115/214] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:09 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:09.826109 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4d61785-c3b4-407f-8811-65e90bf5df74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:09.834489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b4d61785-c3b4-407f-8811-65e90bf5df74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.165478 May 26 12:49:09.835379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 100/215] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:09 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:10.834427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f888fb06-0b2c-496d-a1ff-0a3f08abf9c0 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:10.835136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f888fb06-0b2c-496d-a1ff-0a3f08abf9c0 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:10.842263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f888fb06-0b2c-496d-a1ff-0a3f08abf9c0 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:10.842748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f888fb06-0b2c-496d-a1ff-0a3f08abf9c0 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:10.843515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f888fb06-0b2c-496d-a1ff-0a3f08abf9c0 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:10.843951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f888fb06-0b2c-496d-a1ff-0a3f08abf9c0 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:10.851863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-509f1ce1-d969-4805-80f3-0a9093f8ae00 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:10.852702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-509f1ce1-d969-4805-80f3-0a9093f8ae00 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:10.860440 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-509f1ce1-d969-4805-80f3-0a9093f8ae00 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:10.860818 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-509f1ce1-d969-4805-80f3-0a9093f8ae00 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:10.861591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-509f1ce1-d969-4805-80f3-0a9093f8ae00 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:10.862024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-509f1ce1-d969-4805-80f3-0a9093f8ae00 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:10.911840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f888fb06-0b2c-496d-a1ff-0a3f08abf9c0 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:10.921633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f888fb06-0b2c-496d-a1ff-0a3f08abf9c0 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1345 microversion: 2.1 time: 0.090326 May 26 12:49:10.922457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 116/216] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:10 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:10.998214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-509f1ce1-d969-4805-80f3-0a9093f8ae00 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:11.007611 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-509f1ce1-d969-4805-80f3-0a9093f8ae00 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.159653 May 26 12:49:11.008491 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 101/217] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:10 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:11.939633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efa45fb1-8fa4-48d3-9133-2f44a6594d93 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:11.940249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efa45fb1-8fa4-48d3-9133-2f44a6594d93 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:11.946961 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa45fb1-8fa4-48d3-9133-2f44a6594d93 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:11.947417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa45fb1-8fa4-48d3-9133-2f44a6594d93 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:11.948553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa45fb1-8fa4-48d3-9133-2f44a6594d93 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:11.948992 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa45fb1-8fa4-48d3-9133-2f44a6594d93 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:12.018369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-efa45fb1-8fa4-48d3-9133-2f44a6594d93 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:12.026361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3042d0d3-5272-4167-8326-ee9e7f29bec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:12.027006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3042d0d3-5272-4167-8326-ee9e7f29bec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:12.027768 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efa45fb1-8fa4-48d3-9133-2f44a6594d93 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1345 microversion: 2.1 time: 0.092048 May 26 12:49:12.028357 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 117/218] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:11 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:12.033541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3042d0d3-5272-4167-8326-ee9e7f29bec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:12.033914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3042d0d3-5272-4167-8326-ee9e7f29bec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:12.034733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3042d0d3-5272-4167-8326-ee9e7f29bec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:12.035179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3042d0d3-5272-4167-8326-ee9e7f29bec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:12.174755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3042d0d3-5272-4167-8326-ee9e7f29bec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:12.182411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3042d0d3-5272-4167-8326-ee9e7f29bec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.160685 May 26 12:49:12.183001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 102/219] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:12 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:13.044361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04837e7e-11bc-4304-b6bb-d785e1cf9e9d tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:13.044981 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-04837e7e-11bc-4304-b6bb-d785e1cf9e9d tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:13.051378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04837e7e-11bc-4304-b6bb-d785e1cf9e9d tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:13.051841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04837e7e-11bc-4304-b6bb-d785e1cf9e9d tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:13.052618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04837e7e-11bc-4304-b6bb-d785e1cf9e9d tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:13.053123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04837e7e-11bc-4304-b6bb-d785e1cf9e9d tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:13.124152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04837e7e-11bc-4304-b6bb-d785e1cf9e9d tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:13.133056 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04837e7e-11bc-4304-b6bb-d785e1cf9e9d tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1345 microversion: 2.1 time: 0.092780 May 26 12:49:13.136017 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 118/220] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:13 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:13.200162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0fa039ac-e7df-4c0d-b6d5-415fa158ca21 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:13.200785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0fa039ac-e7df-4c0d-b6d5-415fa158ca21 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:13.207477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fa039ac-e7df-4c0d-b6d5-415fa158ca21 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:13.208111 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fa039ac-e7df-4c0d-b6d5-415fa158ca21 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:13.208838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fa039ac-e7df-4c0d-b6d5-415fa158ca21 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:13.209335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fa039ac-e7df-4c0d-b6d5-415fa158ca21 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:13.343930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fa039ac-e7df-4c0d-b6d5-415fa158ca21 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:13.352067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0fa039ac-e7df-4c0d-b6d5-415fa158ca21 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.156498 May 26 12:49:13.353693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 103/221] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:13 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:14.157150 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:14.159076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:14.169933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=46 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:14.174575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.174575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:14.174575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.174575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:14.209629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.210086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:14.210580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lazy-loading 'fault' on Instance uuid b9a00e0a-5352-49bb-bb1e-b77d70358cfa {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:49:14.264042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b148a9fa622488197fc684ccb665e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b96e086a2544f6863deb39403e425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:14.270419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52ccfe94-f0f0-43e5-aec3-41ed80108e9c tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 200 len: 1350 microversion: 2.1 time: 0.121864 May 26 12:49:14.271139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 119/222] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:14 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 1350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:14.370967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e312ac9f-ce60-4c7e-b3b3-ddeff6ecfbaa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:14.372036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e312ac9f-ce60-4c7e-b3b3-ddeff6ecfbaa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:14.379449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e312ac9f-ce60-4c7e-b3b3-ddeff6ecfbaa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.385932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e312ac9f-ce60-4c7e-b3b3-ddeff6ecfbaa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:14.385932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e312ac9f-ce60-4c7e-b3b3-ddeff6ecfbaa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.385932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e312ac9f-ce60-4c7e-b3b3-ddeff6ecfbaa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:14.529121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e312ac9f-ce60-4c7e-b3b3-ddeff6ecfbaa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:14.543391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e312ac9f-ce60-4c7e-b3b3-ddeff6ecfbaa tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.175924 May 26 12:49:14.544531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 104/223] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:14 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:15.289365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:15.290070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:15.297214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:15.297661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.298440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:15.298898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.303046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:15.313993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] HTTP exception thrown: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Request method failure captured: May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa HTTP/1.1 May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bnsb9vRPRegnJzoh-TP2xlgcE-sOoy808TnINkErpwUxsAFmzHGZBPDD6j-Y4rT9buuJ5xhHLrbaHeOPeX1f5uYP4Zd_I6C5xM63B2gVkKRV_k9pVg8RqXi9NETHgTzFVg5tvnUJtN3OVLXDJyv9_mEyPutPqAiEeH1AKuj86PNwU May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 20b96e086a2544f6863deb39403e425c May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:49:15.326921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20b96e086a2544f6863deb39403e425c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b96e086a2544f6863deb39403e425c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b96e086a2544f6863deb39403e425c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20b96e086a2544f6863deb39403e425c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 20b96e086a2544f6863deb39403e425c May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-DeleteServersTestJSON-1810657976-project May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 6b148a9fa622488197fc684ccb665e1b May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-DeleteServersTestJSON-1810657976-project May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.328840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'b9a00e0a-5352-49bb-bb1e-b77d70358cfa'} May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:15.329534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.330664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:15.331626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Returning 404 to user: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:15.331626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8ff3c44d-482d-4f3e-a310-9e3777a5c067 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 404 len: 111 microversion: 2.1 time: 0.044035 May 26 12:49:15.331626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 120/224] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:15 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:49:15.438635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:15.439587 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:15.446318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:15.447886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.448340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:15.448784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.461566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] HTTP exception thrown: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Request method failure captured: May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa/os-volume_attachments HTTP/1.1 May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bnsb9vRPRegnJzoh-TP2xlgcE-sOoy808TnINkErpwUxsAFmzHGZBPDD6j-Y4rT9buuJ5xhHLrbaHeOPeX1f5uYP4Zd_I6C5xM63B2gVkKRV_k9pVg8RqXi9NETHgTzFVg5tvnUJtN3OVLXDJyv9_mEyPutPqAiEeH1AKuj86PNwU May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 20b96e086a2544f6863deb39403e425c May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:49:15.466648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20b96e086a2544f6863deb39403e425c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b96e086a2544f6863deb39403e425c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b96e086a2544f6863deb39403e425c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20b96e086a2544f6863deb39403e425c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 20b96e086a2544f6863deb39403e425c May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-DeleteServersTestJSON-1810657976-project May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 6b148a9fa622488197fc684ccb665e1b May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-DeleteServersTestJSON-1810657976-project May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.467871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'server_id': 'b9a00e0a-5352-49bb-bb1e-b77d70358cfa'} May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:15.468531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:15.469603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:15.471994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Returning 404 to user: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:15.471994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da7af9f0-f7a7-46b7-9b09-501bfec40e48 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033535 May 26 12:49:15.471994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 105/225] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:49:15 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:49:15.569330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f50db75d-e109-45e5-9997-68acc92f2b27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:15.569886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f50db75d-e109-45e5-9997-68acc92f2b27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:15.577306 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50db75d-e109-45e5-9997-68acc92f2b27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:15.579818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50db75d-e109-45e5-9997-68acc92f2b27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.579818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50db75d-e109-45e5-9997-68acc92f2b27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:15.579818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50db75d-e109-45e5-9997-68acc92f2b27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.753978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f50db75d-e109-45e5-9997-68acc92f2b27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:15.766674 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f50db75d-e109-45e5-9997-68acc92f2b27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.201764 May 26 12:49:15.768414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 121/226] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:15 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:16.785432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-260efb34-005c-48a5-be8a-52cbf271ce2e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:16.786033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-260efb34-005c-48a5-be8a-52cbf271ce2e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:16.794636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-260efb34-005c-48a5-be8a-52cbf271ce2e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:16.795088 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-260efb34-005c-48a5-be8a-52cbf271ce2e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:16.795947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-260efb34-005c-48a5-be8a-52cbf271ce2e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:16.796477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-260efb34-005c-48a5-be8a-52cbf271ce2e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:16.945736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-260efb34-005c-48a5-be8a-52cbf271ce2e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:16.956692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-260efb34-005c-48a5-be8a-52cbf271ce2e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.174134 May 26 12:49:16.958485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 106/227] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:16 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:17.975204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0eb86a1-1cc9-4476-bea2-3f89d38b7009 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:17.975827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e0eb86a1-1cc9-4476-bea2-3f89d38b7009 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:17.987098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0eb86a1-1cc9-4476-bea2-3f89d38b7009 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:17.991100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0eb86a1-1cc9-4476-bea2-3f89d38b7009 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:17.991100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0eb86a1-1cc9-4476-bea2-3f89d38b7009 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:17.991100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0eb86a1-1cc9-4476-bea2-3f89d38b7009 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:18.139196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0eb86a1-1cc9-4476-bea2-3f89d38b7009 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:18.146710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e0eb86a1-1cc9-4476-bea2-3f89d38b7009 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.175591 May 26 12:49:18.147272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 122/228] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:17 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:19.172368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15f2baf6-9741-4c35-8f32-faf82539a752 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:19.172949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15f2baf6-9741-4c35-8f32-faf82539a752 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:19.179750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15f2baf6-9741-4c35-8f32-faf82539a752 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:19.180206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15f2baf6-9741-4c35-8f32-faf82539a752 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:19.181333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15f2baf6-9741-4c35-8f32-faf82539a752 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:19.181777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15f2baf6-9741-4c35-8f32-faf82539a752 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:19.330147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-15f2baf6-9741-4c35-8f32-faf82539a752 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:19.334022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:19.339983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15f2baf6-9741-4c35-8f32-faf82539a752 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.172008 May 26 12:49:19.340570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 107/229] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:19 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:20.357503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f232367-f77e-4d98-9a7d-bcf326126d7f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:20.358148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f232367-f77e-4d98-9a7d-bcf326126d7f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:20.364294 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f232367-f77e-4d98-9a7d-bcf326126d7f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:20.364751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f232367-f77e-4d98-9a7d-bcf326126d7f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:20.365524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f232367-f77e-4d98-9a7d-bcf326126d7f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:20.365964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f232367-f77e-4d98-9a7d-bcf326126d7f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:20.522253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f232367-f77e-4d98-9a7d-bcf326126d7f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:20.532052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f232367-f77e-4d98-9a7d-bcf326126d7f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.178868 May 26 12:49:20.532641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 123/230] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:20 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:21.550452 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba576eb1-f6c9-48d1-a2bb-f44bd1a92089 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:21.551180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba576eb1-f6c9-48d1-a2bb-f44bd1a92089 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:21.557959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba576eb1-f6c9-48d1-a2bb-f44bd1a92089 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:21.558411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba576eb1-f6c9-48d1-a2bb-f44bd1a92089 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:21.559209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba576eb1-f6c9-48d1-a2bb-f44bd1a92089 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:21.559650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba576eb1-f6c9-48d1-a2bb-f44bd1a92089 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:21.698487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba576eb1-f6c9-48d1-a2bb-f44bd1a92089 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:21.706788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba576eb1-f6c9-48d1-a2bb-f44bd1a92089 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.160505 May 26 12:49:21.707430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 108/231] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:21 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:22.723976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52d8a74b-a7a5-4f53-8103-5180af834f2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:22.724593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52d8a74b-a7a5-4f53-8103-5180af834f2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:22.731399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52d8a74b-a7a5-4f53-8103-5180af834f2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:22.731857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52d8a74b-a7a5-4f53-8103-5180af834f2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:22.732636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52d8a74b-a7a5-4f53-8103-5180af834f2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:22.733078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52d8a74b-a7a5-4f53-8103-5180af834f2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:22.869897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52d8a74b-a7a5-4f53-8103-5180af834f2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:22.878432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52d8a74b-a7a5-4f53-8103-5180af834f2c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1522 microversion: 2.1 time: 0.158384 May 26 12:49:22.879043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 124/232] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:22 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:23.894917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1aadaa5f-ec17-4719-939f-14c0f104a90c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:23.895547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1aadaa5f-ec17-4719-939f-14c0f104a90c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:23.902921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1aadaa5f-ec17-4719-939f-14c0f104a90c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.903417 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1aadaa5f-ec17-4719-939f-14c0f104a90c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.904195 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1aadaa5f-ec17-4719-939f-14c0f104a90c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.904645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1aadaa5f-ec17-4719-939f-14c0f104a90c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.934700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:23.935250 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:23.941688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.942138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.942960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.943395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.958760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] HTTP exception thrown: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Request method failure captured: May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa HTTP/1.1 May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bnsb9vRPRegnJzoh-TP2xlgcE-sOoy808TnINkErpwUxsAFmzHGZBPDD6j-Y4rT9buuJ5xhHLrbaHeOPeX1f5uYP4Zd_I6C5xM63B2gVkKRV_k9pVg8RqXi9NETHgTzFVg5tvnUJtN3OVLXDJyv9_mEyPutPqAiEeH1AKuj86PNwU May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 20b96e086a2544f6863deb39403e425c May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:49:23.960334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20b96e086a2544f6863deb39403e425c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b96e086a2544f6863deb39403e425c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b96e086a2544f6863deb39403e425c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20b96e086a2544f6863deb39403e425c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 20b96e086a2544f6863deb39403e425c May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-DeleteServersTestJSON-1810657976-project May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 6b148a9fa622488197fc684ccb665e1b May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-DeleteServersTestJSON-1810657976-project May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:23.961861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'b9a00e0a-5352-49bb-bb1e-b77d70358cfa'} May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:23.968314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:23.970366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:23.972496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Returning 404 to user: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:23.972496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec329597-2bf4-4a07-8e0e-262809a6eb31 tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 404 len: 111 microversion: 2.1 time: 0.031305 May 26 12:49:23.972496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 125/233] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:49:23 2022] DELETE /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:49:23.974387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:23.975059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] [instance: b9a00e0a-5352-49bb-bb1e-b77d70358cfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:23.982614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.982964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.983760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.984201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.999416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] HTTP exception thrown: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Request method failure captured: May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa HTTP/1.1 May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bnsb9vRPRegnJzoh-TP2xlgcE-sOoy808TnINkErpwUxsAFmzHGZBPDD6j-Y4rT9buuJ5xhHLrbaHeOPeX1f5uYP4Zd_I6C5xM63B2gVkKRV_k9pVg8RqXi9NETHgTzFVg5tvnUJtN3OVLXDJyv9_mEyPutPqAiEeH1AKuj86PNwU May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 20b96e086a2544f6863deb39403e425c May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:49:24.001621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20b96e086a2544f6863deb39403e425c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b96e086a2544f6863deb39403e425c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b96e086a2544f6863deb39403e425c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20b96e086a2544f6863deb39403e425c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 20b96e086a2544f6863deb39403e425c May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1810657976 May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-DeleteServersTestJSON-1810657976-project May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 6b148a9fa622488197fc684ccb665e1b May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-DeleteServersTestJSON-1810657976-project May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:24.003004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'b9a00e0a-5352-49bb-bb1e-b77d70358cfa'} May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:24.003787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. May 26 12:49:24.005063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:49:24.006291 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] Returning 404 to user: Instance b9a00e0a-5352-49bb-bb1e-b77d70358cfa could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:24.006291 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d00f93e3-203e-4106-8be1-cdff206b87ca tempest-DeleteServersTestJSON-1810657976 tempest-DeleteServersTestJSON-1810657976-project] 10.222.0.60 "GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa" status: 404 len: 111 microversion: 2.1 time: 0.032681 May 26 12:49:24.006291 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 126/234] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:23 2022] GET /compute/v2.1/servers/b9a00e0a-5352-49bb-bb1e-b77d70358cfa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:49:24.267862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1aadaa5f-ec17-4719-939f-14c0f104a90c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:24.277096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1aadaa5f-ec17-4719-939f-14c0f104a90c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1502 microversion: 2.1 time: 0.385213 May 26 12:49:24.277750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 109/235] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:23 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1502 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:24.294420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a298ef38-5476-4988-b1db-a8fe4eef22fb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:24.295083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a298ef38-5476-4988-b1db-a8fe4eef22fb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:24.301633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a298ef38-5476-4988-b1db-a8fe4eef22fb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:24.302085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a298ef38-5476-4988-b1db-a8fe4eef22fb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:24.302891 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a298ef38-5476-4988-b1db-a8fe4eef22fb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:24.303327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a298ef38-5476-4988-b1db-a8fe4eef22fb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:24.481523 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a298ef38-5476-4988-b1db-a8fe4eef22fb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:24.491946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a298ef38-5476-4988-b1db-a8fe4eef22fb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1517 microversion: 2.1 time: 0.202059 May 26 12:49:24.492527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 127/236] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:24 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:28.139710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8d73bc4d-9bee-49e3-860d-690b0701a940 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:28.141228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8d73bc4d-9bee-49e3-860d-690b0701a940 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:28.147971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d73bc4d-9bee-49e3-860d-690b0701a940 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:28.148422 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d73bc4d-9bee-49e3-860d-690b0701a940 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:28.155377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d73bc4d-9bee-49e3-860d-690b0701a940 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:28.155377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d73bc4d-9bee-49e3-860d-690b0701a940 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:28.184573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-8d73bc4d-9bee-49e3-860d-690b0701a940 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lazy-loading 'flavor' on Instance uuid 9f291eb7-afa2-456e-8494-97b63e9f2144 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:49:28.664650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8d73bc4d-9bee-49e3-860d-690b0701a940 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144/action" status: 200 len: 32 microversion: 2.1 time: 0.529230 May 26 12:49:28.665537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 110/237] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:49:28 2022] POST /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144/action => generated 32 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:49:28.678750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d39be741-dc9a-4c6d-bb3f-e7b954c4c430 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:28.683760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d39be741-dc9a-4c6d-bb3f-e7b954c4c430 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:28.696524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d39be741-dc9a-4c6d-bb3f-e7b954c4c430 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:28.696998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d39be741-dc9a-4c6d-bb3f-e7b954c4c430 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:28.697799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d39be741-dc9a-4c6d-bb3f-e7b954c4c430 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:28.698926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d39be741-dc9a-4c6d-bb3f-e7b954c4c430 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:28.841534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d39be741-dc9a-4c6d-bb3f-e7b954c4c430 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:28.849549 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d39be741-dc9a-4c6d-bb3f-e7b954c4c430 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.178550 May 26 12:49:28.850122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 128/238] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:28 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:29.868028 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6c6aaac-f389-4bea-980c-4abe92972850 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:29.868850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6c6aaac-f389-4bea-980c-4abe92972850 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:29.875278 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6c6aaac-f389-4bea-980c-4abe92972850 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:29.876071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6c6aaac-f389-4bea-980c-4abe92972850 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:29.876951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6c6aaac-f389-4bea-980c-4abe92972850 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:29.877381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6c6aaac-f389-4bea-980c-4abe92972850 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:30.072131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6c6aaac-f389-4bea-980c-4abe92972850 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:30.081332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6c6aaac-f389-4bea-980c-4abe92972850 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.218543 May 26 12:49:30.081913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 111/239] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:29 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:31.100285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c3b14551-1074-4769-b266-57d09a4b6556 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:31.100899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c3b14551-1074-4769-b266-57d09a4b6556 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:31.108408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3b14551-1074-4769-b266-57d09a4b6556 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:31.108861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3b14551-1074-4769-b266-57d09a4b6556 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:31.109638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3b14551-1074-4769-b266-57d09a4b6556 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:31.110100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3b14551-1074-4769-b266-57d09a4b6556 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:31.431503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c3b14551-1074-4769-b266-57d09a4b6556 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:31.440123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c3b14551-1074-4769-b266-57d09a4b6556 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.343313 May 26 12:49:31.447041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 129/240] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:31 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:32.459348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e29c179-3cac-4814-9041-cc129e089733 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:32.462838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e29c179-3cac-4814-9041-cc129e089733 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:32.472470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e29c179-3cac-4814-9041-cc129e089733 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:32.473507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e29c179-3cac-4814-9041-cc129e089733 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:32.474293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e29c179-3cac-4814-9041-cc129e089733 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:32.475043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e29c179-3cac-4814-9041-cc129e089733 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:32.843640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e29c179-3cac-4814-9041-cc129e089733 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:32.843640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e29c179-3cac-4814-9041-cc129e089733 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.366950 May 26 12:49:32.843640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 112/241] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:32 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:33.841949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d3cd8155-64aa-4929-b84f-a55a2c2359b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:33.842569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d3cd8155-64aa-4929-b84f-a55a2c2359b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:33.848614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3cd8155-64aa-4929-b84f-a55a2c2359b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:33.849121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3cd8155-64aa-4929-b84f-a55a2c2359b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:33.849882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3cd8155-64aa-4929-b84f-a55a2c2359b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:33.850319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3cd8155-64aa-4929-b84f-a55a2c2359b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:34.476373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3cd8155-64aa-4929-b84f-a55a2c2359b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:34.488655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d3cd8155-64aa-4929-b84f-a55a2c2359b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.649262 May 26 12:49:34.489267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 130/242] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:33 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:34.899916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-474c2642-e12d-4e97-9ccf-2c772b07dbdb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'create', calling method: .version_select at 0x7f498c4b1c10>, body: {"keypair": {"name": "tempest-keypair-1142527771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+dTjGKMDAToctdMza0j1OJjRxQplfG2qp7omVKV0gTnRj8u2Qrs1nzWr9vDdrjGUSRpWQ4wej/WsodEV8wx3OUjK6WpR5oRDkuWJVma0LqW17nx+TfI5HcMzrJx3si4A=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:34.918957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-474c2642-e12d-4e97-9ccf-2c772b07dbdb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Getting quotas for project 60655349037a415e8d26e794e9d3cc79. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:34.927403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-474c2642-e12d-4e97-9ccf-2c772b07dbdb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Getting quotas for user 34cd6fbd9b654e31a387acc25ee94d44 and project 60655349037a415e8d26e794e9d3cc79. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:35.108023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-474c2642-e12d-4e97-9ccf-2c772b07dbdb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.411583 May 26 12:49:35.108023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 113/243] 10.222.0.60 () {62 vars in 1199 bytes} [Thu May 26 12:49:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 413 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 12:49:35.506986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d63c753a-e5af-44c8-bd6c-df04a6237da5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:35.507600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d63c753a-e5af-44c8-bd6c-df04a6237da5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:35.514491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d63c753a-e5af-44c8-bd6c-df04a6237da5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:35.514975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d63c753a-e5af-44c8-bd6c-df04a6237da5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:35.515742 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d63c753a-e5af-44c8-bd6c-df04a6237da5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:35.516181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d63c753a-e5af-44c8-bd6c-df04a6237da5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:35.737700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d63c753a-e5af-44c8-bd6c-df04a6237da5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:35.746812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d63c753a-e5af-44c8-bd6c-df04a6237da5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.243586 May 26 12:49:35.747819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 131/244] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:35 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:36.767697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3581ecd2-3433-4510-97f2-ee87c5c56663 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:36.768316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3581ecd2-3433-4510-97f2-ee87c5c56663 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:36.772666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:36.798189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3581ecd2-3433-4510-97f2-ee87c5c56663 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:36.798969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3581ecd2-3433-4510-97f2-ee87c5c56663 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:36.799550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3581ecd2-3433-4510-97f2-ee87c5c56663 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:36.800000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3581ecd2-3433-4510-97f2-ee87c5c56663 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:37.125739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3581ecd2-3433-4510-97f2-ee87c5c56663 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:37.137032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3581ecd2-3433-4510-97f2-ee87c5c56663 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.376467 May 26 12:49:37.138280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 114/245] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:36 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:38.155229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c41e2bf-707b-4d09-898a-a26702a834d6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:38.156718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c41e2bf-707b-4d09-898a-a26702a834d6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:38.166796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c41e2bf-707b-4d09-898a-a26702a834d6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:38.168014 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c41e2bf-707b-4d09-898a-a26702a834d6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.168856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c41e2bf-707b-4d09-898a-a26702a834d6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:38.169299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c41e2bf-707b-4d09-898a-a26702a834d6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.324839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c41e2bf-707b-4d09-898a-a26702a834d6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:38.333608 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c41e2bf-707b-4d09-898a-a26702a834d6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.183048 May 26 12:49:38.334616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 132/246] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:38 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:38.985850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-19763835", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83127c00-08da-4fe7-8cef-eaed67104a46"}], "security_groups": [{"name": "tempest-securitygroup--604032463"}], "key_name": "tempest-keypair-1142527771", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:39.117164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] validate_networks() for [('83127c00-08da-4fe7-8cef-eaed67104a46', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:49:39.352995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8d6522d-e4e1-444d-8d12-6b95ffe4cfaf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:39.353706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8d6522d-e4e1-444d-8d12-6b95ffe4cfaf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:39.361027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8d6522d-e4e1-444d-8d12-6b95ffe4cfaf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.361477 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8d6522d-e4e1-444d-8d12-6b95ffe4cfaf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.364957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8d6522d-e4e1-444d-8d12-6b95ffe4cfaf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.364957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8d6522d-e4e1-444d-8d12-6b95ffe4cfaf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.503864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f8d6522d-e4e1-444d-8d12-6b95ffe4cfaf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.518795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:49:39.518961 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8d6522d-e4e1-444d-8d12-6b95ffe4cfaf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.170678 May 26 12:49:39.519555 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 133/247] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:39 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:39.519664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:49:39.520422 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:49:39.520859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:49:39.521335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:49:39.535573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.536080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.536870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.537558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.556004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Getting quotas for project 60655349037a415e8d26e794e9d3cc79. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:39.560799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Getting quotas for user 34cd6fbd9b654e31a387acc25ee94d44 and project 60655349037a415e8d26e794e9d3cc79. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:39.572686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:49:39.575846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:49:39.767207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7faaba8d-2ec4-40c0-8f6a-ff3d2b1d4472 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.786275 May 26 12:49:39.767887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 115/248] 10.222.0.60 () {62 vars in 1187 bytes} [Thu May 26 12:49:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 26 12:49:39.778160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2330718-0dbd-40da-9ef8-fb1f2dbb4073 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:39.778803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2330718-0dbd-40da-9ef8-fb1f2dbb4073 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:39.843515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2330718-0dbd-40da-9ef8-fb1f2dbb4073 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.850738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2330718-0dbd-40da-9ef8-fb1f2dbb4073 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.852237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2330718-0dbd-40da-9ef8-fb1f2dbb4073 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.853333 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2330718-0dbd-40da-9ef8-fb1f2dbb4073 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1280 microversion: 2.20 time: 0.079173 May 26 12:49:39.860639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 134/249] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:39 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:40.537067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13c41d37-c67f-4e1b-bbea-31ac1e479590 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:40.537690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-13c41d37-c67f-4e1b-bbea-31ac1e479590 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:40.545303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13c41d37-c67f-4e1b-bbea-31ac1e479590 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.545748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13c41d37-c67f-4e1b-bbea-31ac1e479590 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.546607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13c41d37-c67f-4e1b-bbea-31ac1e479590 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.547053 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13c41d37-c67f-4e1b-bbea-31ac1e479590 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.696060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-13c41d37-c67f-4e1b-bbea-31ac1e479590 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:40.704532 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-13c41d37-c67f-4e1b-bbea-31ac1e479590 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.171907 May 26 12:49:40.705052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 116/250] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:40 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:40.871591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-83016ab4-479a-4d39-8354-5ebcb0f49a52 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:40.872233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-83016ab4-479a-4d39-8354-5ebcb0f49a52 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:40.926083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83016ab4-479a-4d39-8354-5ebcb0f49a52 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:40.934407 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83016ab4-479a-4d39-8354-5ebcb0f49a52 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:40.935983 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83016ab4-479a-4d39-8354-5ebcb0f49a52 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:40.939079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-83016ab4-479a-4d39-8354-5ebcb0f49a52 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1280 microversion: 2.20 time: 0.069664 May 26 12:49:40.939079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 135/251] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:40 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:41.720944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e321296-af67-4f70-90b1-4c086e4b2885 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:41.721548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e321296-af67-4f70-90b1-4c086e4b2885 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:41.728007 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e321296-af67-4f70-90b1-4c086e4b2885 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.728457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e321296-af67-4f70-90b1-4c086e4b2885 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:41.729714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e321296-af67-4f70-90b1-4c086e4b2885 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.730152 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e321296-af67-4f70-90b1-4c086e4b2885 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:41.859516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e321296-af67-4f70-90b1-4c086e4b2885 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:41.867170 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e321296-af67-4f70-90b1-4c086e4b2885 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.149982 May 26 12:49:41.867734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 117/252] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:41 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:41.956098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:41.957048 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:41.963083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.964024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:41.965105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.965551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:42.031710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:42.040157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:42.042325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:42.043505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e5ca16b5-aad2-4bad-8b96-3130fdb02ede tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1284 microversion: 2.20 time: 0.092217 May 26 12:49:42.044167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 136/253] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:41 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:42.890600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd5eb79a-5fee-41ae-8610-dbc93a3560d5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:42.891270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd5eb79a-5fee-41ae-8610-dbc93a3560d5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:42.897269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd5eb79a-5fee-41ae-8610-dbc93a3560d5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:42.897714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd5eb79a-5fee-41ae-8610-dbc93a3560d5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:42.898477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd5eb79a-5fee-41ae-8610-dbc93a3560d5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:42.898987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd5eb79a-5fee-41ae-8610-dbc93a3560d5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.035104 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd5eb79a-5fee-41ae-8610-dbc93a3560d5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:43.043039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd5eb79a-5fee-41ae-8610-dbc93a3560d5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1503 microversion: 2.1 time: 0.157645 May 26 12:49:43.043617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 118/254] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:42 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:43.061841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:43.062483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:43.064129 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15f4b264-4f58-4f98-9b3d-c383174fc72b"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:43.065314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:43.078175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.078673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.079490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.080232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.081186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.081622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.082461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.083272 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.107567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] HTTP exception thrown: Cannot 'attach_volume' instance 9f291eb7-afa2-456e-8494-97b63e9f2144 while it is in vm_state rescued May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Request method failure captured: May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144/os-volume_attachments HTTP/1.1 May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 74 May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvtkij4vGeBs7o_ED6e20XDMM79LFEkKwE8zRDpvN-e3EokvsRt-JGUUN4Oo94FKBMSuwxb2TwC31iolTdyP5G4mlFFfHCkb5zEc8xpa6Jvr0JXGOIAg35z_iMaus7NIylOEpTQw4UMLS4Hqw6q9SWL-MOnMbMad1TU8wvSpoQUoY May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:49:43.109259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: e24e8e8d0b8042bfb7ee7881aa8a16c1 May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {"volumeAttachment": {"volumeId": "15f4b264-4f58-4f98-9b3d-c383174fc72b"}} May 26 12:49:43.110515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Cannot 'attach_volume' instance 9f291eb7-afa2-456e-8494-97b63e9f2144 while it is in vm_state rescued May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '9f291eb7-afa2-456e-8494-97b63e9f2144', 'body': {'volumeAttachment': {'volumeId': '15f4b264-4f58-4f98-9b3d-c383174fc72b'}}} May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f291eb7-afa2-456e-8494-97b63e9f2144 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:43.111349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9f291eb7-afa2-456e-8494-97b63e9f2144 while it is in vm_state rescued May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:43.112419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:43.113453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:43.113453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:43.113453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9f291eb7-afa2-456e-8494-97b63e9f2144 while it is in vm_state rescued May 26 12:49:43.113453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:49:43.113453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Returning 409 to user: Cannot 'attach_volume' instance 9f291eb7-afa2-456e-8494-97b63e9f2144 while it is in vm_state rescued {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:43.113453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0760bd51-7741-478a-bbad-bf023ccec980 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050900 May 26 12:49:43.113453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 119/255] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:49:43 2022] POST /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 12:49:43.119665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-27b770b4-9842-43cf-9bd2-9f3519b8b42b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:43.120398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-27b770b4-9842-43cf-9bd2-9f3519b8b42b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:43.127125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27b770b4-9842-43cf-9bd2-9f3519b8b42b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.127575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27b770b4-9842-43cf-9bd2-9f3519b8b42b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.128454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27b770b4-9842-43cf-9bd2-9f3519b8b42b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.128894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27b770b4-9842-43cf-9bd2-9f3519b8b42b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.160589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:43.169590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:43.177633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:43.177633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8452f751-e538-40e5-a4bb-642d5864905c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1332 microversion: 2.20 time: 0.114875 May 26 12:49:43.177633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 137/256] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:43 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:43.440429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-27b770b4-9842-43cf-9bd2-9f3519b8b42b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144/action" status: 202 len: 0 microversion: 2.1 time: 0.324128 May 26 12:49:43.444236 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 120/257] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:49:43 2022] POST /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:49:43.450258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d87f7c5-6b61-4aea-b299-a438be43af03 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:43.450908 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d87f7c5-6b61-4aea-b299-a438be43af03 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:43.457068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d87f7c5-6b61-4aea-b299-a438be43af03 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.457524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d87f7c5-6b61-4aea-b299-a438be43af03 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.458316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d87f7c5-6b61-4aea-b299-a438be43af03 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.458792 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d87f7c5-6b61-4aea-b299-a438be43af03 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.594811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d87f7c5-6b61-4aea-b299-a438be43af03 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:43.602182 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d87f7c5-6b61-4aea-b299-a438be43af03 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1511 microversion: 2.1 time: 0.156612 May 26 12:49:43.602776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 138/258] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:43 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:44.194381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:44.195093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:44.201450 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.201896 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.202687 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.203125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.266814 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:44.274695 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:44.276921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:44.278023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05e771aa-e9e9-4a4e-80d8-3de9a2ce2849 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1332 microversion: 2.20 time: 0.088379 May 26 12:49:44.278585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 121/259] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:44 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:44.619268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1b3b06c9-7f33-4875-9880-0d82bc1570cb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:44.620457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1b3b06c9-7f33-4875-9880-0d82bc1570cb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:44.626512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b3b06c9-7f33-4875-9880-0d82bc1570cb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.626969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b3b06c9-7f33-4875-9880-0d82bc1570cb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.627735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b3b06c9-7f33-4875-9880-0d82bc1570cb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.628173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b3b06c9-7f33-4875-9880-0d82bc1570cb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.758996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1b3b06c9-7f33-4875-9880-0d82bc1570cb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:44.767018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1b3b06c9-7f33-4875-9880-0d82bc1570cb tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1511 microversion: 2.1 time: 0.151637 May 26 12:49:44.767576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 139/260] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:44 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:45.296913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:45.297515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:45.304060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.304447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.305199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.305638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.380501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:45.389090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:45.390628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:45.391807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55918142-0942-4e2b-818e-1122cb88ba75 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1332 microversion: 2.20 time: 0.098695 May 26 12:49:45.392389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 122/261] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:45 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:45.784083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5778ecc2-af83-4d71-b751-44b192ccf075 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:45.784724 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5778ecc2-af83-4d71-b751-44b192ccf075 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:45.786678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=48 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:45.792602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5778ecc2-af83-4d71-b751-44b192ccf075 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.793061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5778ecc2-af83-4d71-b751-44b192ccf075 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.793835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5778ecc2-af83-4d71-b751-44b192ccf075 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.794277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5778ecc2-af83-4d71-b751-44b192ccf075 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.798315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=95 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:45.925929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5778ecc2-af83-4d71-b751-44b192ccf075 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:45.933660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5778ecc2-af83-4d71-b751-44b192ccf075 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1511 microversion: 2.1 time: 0.153377 May 26 12:49:45.934223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 140/262] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:45 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:46.412223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:46.413648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:46.420398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:46.420846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:46.421618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:46.422045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:46.442880 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:46.495786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:46.495786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:46.497031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:46.498130 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f750a780-5c29-4f9c-a860-acc3b9c2ac7c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1332 microversion: 2.20 time: 0.090115 May 26 12:49:46.498692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 123/263] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:46 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:46.950755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-906f209e-1496-481c-8041-83af52f3906e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:46.951397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-906f209e-1496-481c-8041-83af52f3906e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:46.958642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-906f209e-1496-481c-8041-83af52f3906e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:46.959101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-906f209e-1496-481c-8041-83af52f3906e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:46.959865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-906f209e-1496-481c-8041-83af52f3906e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:46.960405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-906f209e-1496-481c-8041-83af52f3906e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:47.097232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-906f209e-1496-481c-8041-83af52f3906e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:47.105586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-906f209e-1496-481c-8041-83af52f3906e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1511 microversion: 2.1 time: 0.158658 May 26 12:49:47.106185 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 141/264] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:46 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:47.517684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:47.518407 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:47.528720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:47.528720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:47.528720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:47.528720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:47.647389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:47.655752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:47.657433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:47.658683 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ed8e7c1e-d5d6-4d97-b12b-d09c1ce5fb44 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1340 microversion: 2.20 time: 0.146374 May 26 12:49:47.659531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 124/265] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:47 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1340 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:48.128132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d1fd670-64ed-45a0-a92a-5cf7b0d27f74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:48.128756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d1fd670-64ed-45a0-a92a-5cf7b0d27f74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:48.139894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d1fd670-64ed-45a0-a92a-5cf7b0d27f74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:48.140434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d1fd670-64ed-45a0-a92a-5cf7b0d27f74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:48.141282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d1fd670-64ed-45a0-a92a-5cf7b0d27f74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:48.141787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d1fd670-64ed-45a0-a92a-5cf7b0d27f74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:48.274294 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d1fd670-64ed-45a0-a92a-5cf7b0d27f74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:48.283022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d1fd670-64ed-45a0-a92a-5cf7b0d27f74 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1511 microversion: 2.1 time: 0.162556 May 26 12:49:48.283338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 142/266] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:48 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:48.679507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:48.680191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:48.687975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:48.694944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:48.694944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:48.694944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:48.956011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:48.966860 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:48.968779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:48.970142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e1091e45-95da-4177-ac7a-7ebb1023e99c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.295287 May 26 12:49:48.971329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 125/267] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:48 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:49.306282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d98f077-64c8-45dd-bfd5-660ea1f289ea tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:49.307158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d98f077-64c8-45dd-bfd5-660ea1f289ea tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:49.313849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d98f077-64c8-45dd-bfd5-660ea1f289ea tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:49.314418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d98f077-64c8-45dd-bfd5-660ea1f289ea tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:49.315465 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d98f077-64c8-45dd-bfd5-660ea1f289ea tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:49.316007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d98f077-64c8-45dd-bfd5-660ea1f289ea tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:49.495697 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d98f077-64c8-45dd-bfd5-660ea1f289ea tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:49.504998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d98f077-64c8-45dd-bfd5-660ea1f289ea tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1511 microversion: 2.1 time: 0.209509 May 26 12:49:49.515029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 143/268] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:49 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:49.997663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:49.998305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:50.002153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:50.005822 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=10 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:50.016752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:50.017797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:50.018807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:50.019290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:50.171864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:50.180053 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:50.181887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:50.183067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bfa28c6e-99f2-4540-a833-f5aad65df166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.196456 May 26 12:49:50.184144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 126/269] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:49 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:50.521916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9d9640c-989e-4151-95aa-ebe41453670e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:50.522558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9d9640c-989e-4151-95aa-ebe41453670e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:50.537398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9d9640c-989e-4151-95aa-ebe41453670e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:50.537880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9d9640c-989e-4151-95aa-ebe41453670e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:50.538897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9d9640c-989e-4151-95aa-ebe41453670e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:50.539338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9d9640c-989e-4151-95aa-ebe41453670e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:50.713484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9d9640c-989e-4151-95aa-ebe41453670e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:50.723000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9d9640c-989e-4151-95aa-ebe41453670e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1511 microversion: 2.1 time: 0.205227 May 26 12:49:50.734738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 144/270] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:50 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:51.202444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:51.203039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:51.212145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:51.213798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:51.214970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:51.218769 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:51.429592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:51.452735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:51.452958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-42895793-c742-4692-a9cb-9276ec0873f8 req-7628e82f-e515-4a8f-8138-5a0a989fef7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64085992-ecfa-4fbc-a713-04aff66c0042", "tag": "1099ed7a-51bc-411b-8a61-ea93c6361abe"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:51.454489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:51.455656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04975b0c-8a8e-47f6-a1a0-109e1219070e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.257626 May 26 12:49:51.456462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:51.463970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-42895793-c742-4692-a9cb-9276ec0873f8 req-7628e82f-e515-4a8f-8138-5a0a989fef7a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:51.464411 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-42895793-c742-4692-a9cb-9276ec0873f8 req-7628e82f-e515-4a8f-8138-5a0a989fef7a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:51.468100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 127/271] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:51 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:51.485219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-42895793-c742-4692-a9cb-9276ec0873f8 req-7628e82f-e515-4a8f-8138-5a0a989fef7a service nova] Creating event network-changed:1099ed7a-51bc-411b-8a61-ea93c6361abe for instance 64085992-ecfa-4fbc-a713-04aff66c0042 on hv-cinder-81514 May 26 12:49:51.495680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-42895793-c742-4692-a9cb-9276ec0873f8 req-7628e82f-e515-4a8f-8138-5a0a989fef7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046543 May 26 12:49:51.496610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 145/272] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:51.744045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e26ac1b0-c82a-4972-b240-f0bd1d05eec6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:51.745009 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e26ac1b0-c82a-4972-b240-f0bd1d05eec6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:51.753662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e26ac1b0-c82a-4972-b240-f0bd1d05eec6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:51.754457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e26ac1b0-c82a-4972-b240-f0bd1d05eec6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:51.755490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e26ac1b0-c82a-4972-b240-f0bd1d05eec6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:51.756096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e26ac1b0-c82a-4972-b240-f0bd1d05eec6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:52.099862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e26ac1b0-c82a-4972-b240-f0bd1d05eec6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:52.155224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e26ac1b0-c82a-4972-b240-f0bd1d05eec6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1517 microversion: 2.1 time: 0.413821 May 26 12:49:52.156614 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 128/273] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:51 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1517 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:52.477436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:52.478184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:52.495388 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:52.496126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:52.497313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:52.497921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:52.677750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:52.711781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:52.711781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:52.711781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-51d274c7-4337-49be-94ad-4f9001c5fba4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.221815 May 26 12:49:52.712455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 146/274] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:52 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:53.718686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:53.720397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:53.742090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:53.744864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:53.745887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:53.746905 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:53.926090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:53.936091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:53.937892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:53.939253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a170c3a5-8adb-4430-8571-08b35fd18843 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.224709 May 26 12:49:53.939978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 129/275] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:53 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:54.957740 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:54.958365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:54.965612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.965983 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.966811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.967246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:55.119225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-490a9b56-5ea6-44d4-835b-5f706792dc20 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'create', calling method: .version_select at 0x7f498c35ac10>, body: {"keypair": {"name": "tempest-keypair-1656851192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0KqpSi8bN4ra2XA/IIK5LJDS9BvKCXXVtyNrptzHZGVn0L40uH4btpm3Ko0X5cl/2tyhl0gx1kIa8zfCjbPD6xoRX0YNG82XPoW+ikHdZ/JKIo3Qs6b9lcp4DUDbwXtA=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:55.137240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-490a9b56-5ea6-44d4-835b-5f706792dc20 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Getting quotas for project 98c0c747833441bda0a5f8d62de53cd3. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:55.146857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-490a9b56-5ea6-44d4-835b-5f706792dc20 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Getting quotas for user e24e8e8d0b8042bfb7ee7881aa8a16c1 and project 98c0c747833441bda0a5f8d62de53cd3. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:55.212264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:55.221182 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:55.222831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:55.224042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-55287178-0e35-4a0d-a73b-6821611ac2ee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.270668 May 26 12:49:55.224717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 147/276] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:54 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:55.277957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-490a9b56-5ea6-44d4-835b-5f706792dc20 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166265 May 26 12:49:55.279045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 130/277] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 12:49:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:55.860407 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-970886259", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:55.925786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] validate_networks() for None {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:49:56.244000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:56.244613 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:56.253027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:56.253753 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:56.254715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:56.255314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:56.269323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:49:56.269817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:49:56.270235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:49:56.270911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:49:56.271522 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:49:56.282762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:56.283499 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:56.284373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:56.284887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:56.328821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Getting quotas for project a4ab83dbdfb7409bbea3af2745c1ddaf. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:56.345043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Getting quotas for user b760cb7932fc4b3ea0d3e7526f15be0c and project a4ab83dbdfb7409bbea3af2745c1ddaf. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:56.376067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:49:56.378424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:49:56.459997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:56.470652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:56.480039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:56.480039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e7a9eb76-4cf1-44e5-81d5-bfd1f434be6b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.235631 May 26 12:49:56.480039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 131/278] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:56 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:56.525011 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d985eeb-6e74-493d-bf75-90eff5790159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669456 May 26 12:49:56.526008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 148/279] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:49:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:49:56.536630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f65ece0d-a5ea-43af-a505-273e758866f0 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:56.537603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f65ece0d-a5ea-43af-a505-273e758866f0 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:56.616362 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f65ece0d-a5ea-43af-a505-273e758866f0 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:56.625980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f65ece0d-a5ea-43af-a505-273e758866f0 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1214 microversion: 2.1 time: 0.093896 May 26 12:49:56.630872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 132/280] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:56 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:57.496121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:57.496121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:57.503313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.503766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.504551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.505002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.650249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4629b4af-c870-4f37-8b04-b9a972a76d62 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:57.654083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4629b4af-c870-4f37-8b04-b9a972a76d62 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:57.768812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4629b4af-c870-4f37-8b04-b9a972a76d62 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:57.782986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4629b4af-c870-4f37-8b04-b9a972a76d62 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1214 microversion: 2.1 time: 0.137212 May 26 12:49:57.793080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 133/281] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:57 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:57.793080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-3038091a-6fc5-4eed-804d-7b2787c4205a req-a3048c5b-27bc-4915-a899-d2bb72589b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64085992-ecfa-4fbc-a713-04aff66c0042", "name": "network-vif-plugged", "status": "completed", "tag": "1099ed7a-51bc-411b-8a61-ea93c6361abe"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:57.802803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:57.805600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3038091a-6fc5-4eed-804d-7b2787c4205a req-a3048c5b-27bc-4915-a899-d2bb72589b93 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.806065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3038091a-6fc5-4eed-804d-7b2787c4205a req-a3048c5b-27bc-4915-a899-d2bb72589b93 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.821911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-3038091a-6fc5-4eed-804d-7b2787c4205a req-a3048c5b-27bc-4915-a899-d2bb72589b93 service nova] Creating event network-vif-plugged:1099ed7a-51bc-411b-8a61-ea93c6361abe for instance 64085992-ecfa-4fbc-a713-04aff66c0042 on hv-cinder-81514 May 26 12:49:57.823585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:57.825353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:57.826693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a8f4cabf-a8ff-43dd-af9c-830cf58557a4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.337010 May 26 12:49:57.827362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 149/282] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:57 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:57.832194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-3038091a-6fc5-4eed-804d-7b2787c4205a req-a3048c5b-27bc-4915-a899-d2bb72589b93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046615 May 26 12:49:57.832807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 134/283] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:58.800965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b59484cf-5678-401d-b9e2-4939a8e66ed7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:58.802220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b59484cf-5678-401d-b9e2-4939a8e66ed7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:58.811999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b59484cf-5678-401d-b9e2-4939a8e66ed7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.812461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b59484cf-5678-401d-b9e2-4939a8e66ed7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.816253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b59484cf-5678-401d-b9e2-4939a8e66ed7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.816739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b59484cf-5678-401d-b9e2-4939a8e66ed7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.849457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:58.852950 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:58.861920 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.862619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.863542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.864156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.922897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b59484cf-5678-401d-b9e2-4939a8e66ed7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:58.935918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b59484cf-5678-401d-b9e2-4939a8e66ed7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1210 microversion: 2.1 time: 0.138855 May 26 12:49:58.936949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 150/284] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:58 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1210 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:59.086327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-923605174", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76e35e60-6dcf-460f-9f24-e35550b81f28"}], "security_groups": [{"name": "tempest-securitygroup--1060768319"}], "key_name": "tempest-keypair-1656851192", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:59.169549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:59.189323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:59.191229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:59.192593 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0df9b29b-24de-41c3-ae25-8d2b7be5a2e2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.351520 May 26 12:49:59.193509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 135/285] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:49:58 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:59.224661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] validate_networks() for [('76e35e60-6dcf-460f-9f24-e35550b81f28', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:49:59.742088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:49:59.742535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:49:59.743162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:49:59.743576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:49:59.744130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:49:59.753851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:59.754306 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:59.755398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:59.755890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:59.773292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Getting quotas for project 98c0c747833441bda0a5f8d62de53cd3. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:59.777128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Getting quotas for user e24e8e8d0b8042bfb7ee7881aa8a16c1 and project 98c0c747833441bda0a5f8d62de53cd3. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:59.794285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:49:59.796569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:49:59.955143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8af8f2d6-3b8d-4d95-b658-e781d521dccf tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:59.955872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8af8f2d6-3b8d-4d95-b658-e781d521dccf tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:59.963388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8af8f2d6-3b8d-4d95-b658-e781d521dccf tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:59.963842 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8af8f2d6-3b8d-4d95-b658-e781d521dccf tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:59.964769 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8af8f2d6-3b8d-4d95-b658-e781d521dccf tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:59.965209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8af8f2d6-3b8d-4d95-b658-e781d521dccf tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:59.992367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40450b07-1561-4910-beea-90d0aa6f63dc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.911046 May 26 12:49:59.998829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 151/286] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:49:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:50:00.003839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4ea9871b-f69a-49bb-9f51-0457414b0027 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:00.004680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4ea9871b-f69a-49bb-9f51-0457414b0027 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:00.071541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8af8f2d6-3b8d-4d95-b658-e781d521dccf tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:00.081648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8af8f2d6-3b8d-4d95-b658-e781d521dccf tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1266 microversion: 2.1 time: 0.130348 May 26 12:50:00.083936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 136/287] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:59 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:00.136649 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4ea9871b-f69a-49bb-9f51-0457414b0027 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:00.145024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4ea9871b-f69a-49bb-9f51-0457414b0027 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1245 microversion: 2.1 time: 0.144781 May 26 12:50:00.146814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 152/288] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:49:59 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:00.212738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:00.213521 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:00.221017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.221619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.222403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.222928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.437820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:00.448059 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:00.449790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:00.451034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99229aee-376c-4705-bba1-3c350697ebae tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1405 microversion: 2.20 time: 0.243815 May 26 12:50:00.462808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 137/289] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:50:00 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:01.102295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2a81dd1c-bd6e-40fa-a819-91ff728ea9c6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:01.103293 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2a81dd1c-bd6e-40fa-a819-91ff728ea9c6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:01.112649 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a81dd1c-bd6e-40fa-a819-91ff728ea9c6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.113111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a81dd1c-bd6e-40fa-a819-91ff728ea9c6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.114020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a81dd1c-bd6e-40fa-a819-91ff728ea9c6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.115037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a81dd1c-bd6e-40fa-a819-91ff728ea9c6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.165765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b25f5c0-ba74-4a80-8d12-b987024d38e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:01.165765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b25f5c0-ba74-4a80-8d12-b987024d38e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:01.172030 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b25f5c0-ba74-4a80-8d12-b987024d38e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.172494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b25f5c0-ba74-4a80-8d12-b987024d38e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.173334 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b25f5c0-ba74-4a80-8d12-b987024d38e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.174068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b25f5c0-ba74-4a80-8d12-b987024d38e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.285018 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4b25f5c0-ba74-4a80-8d12-b987024d38e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:01.295324 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b25f5c0-ba74-4a80-8d12-b987024d38e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1249 microversion: 2.1 time: 0.136172 May 26 12:50:01.298744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 138/290] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:01 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:01.307861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2a81dd1c-bd6e-40fa-a819-91ff728ea9c6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:01.320616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2a81dd1c-bd6e-40fa-a819-91ff728ea9c6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1274 microversion: 2.1 time: 0.223059 May 26 12:50:01.321209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 153/291] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:01 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:01.469472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:01.470121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:01.477191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.477651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.478446 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.478925 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.622257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:01.633461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:01.635225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:01.636534 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f80ec1f-9d9d-4f56-b5dd-d5ade02995cd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1597 microversion: 2.20 time: 0.171163 May 26 12:50:01.637235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 139/292] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:50:01 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:01.655612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-60b1beae-3a1c-438a-87a5-9e7cabbd9cc4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:01.656532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-60b1beae-3a1c-438a-87a5-9e7cabbd9cc4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:01.670265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60b1beae-3a1c-438a-87a5-9e7cabbd9cc4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.670757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60b1beae-3a1c-438a-87a5-9e7cabbd9cc4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.671568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60b1beae-3a1c-438a-87a5-9e7cabbd9cc4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.672299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60b1beae-3a1c-438a-87a5-9e7cabbd9cc4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.792719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-60b1beae-3a1c-438a-87a5-9e7cabbd9cc4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.140795 May 26 12:50:01.793312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 154/293] 10.222.0.60 () {60 vars in 1315 bytes} [Thu May 26 12:50:01 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:50:02.312974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5266fb46-0348-4518-b351-07ac9166b1c7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:02.314311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5266fb46-0348-4518-b351-07ac9166b1c7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:02.322143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5266fb46-0348-4518-b351-07ac9166b1c7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.322830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5266fb46-0348-4518-b351-07ac9166b1c7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.323800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5266fb46-0348-4518-b351-07ac9166b1c7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.324405 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5266fb46-0348-4518-b351-07ac9166b1c7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.353120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5809def6-be9a-4d39-a411-650c4bc21be7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:02.354400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5809def6-be9a-4d39-a411-650c4bc21be7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:02.368344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5809def6-be9a-4d39-a411-650c4bc21be7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.369051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5809def6-be9a-4d39-a411-650c4bc21be7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.369999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5809def6-be9a-4d39-a411-650c4bc21be7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.370686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5809def6-be9a-4d39-a411-650c4bc21be7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.446241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5266fb46-0348-4518-b351-07ac9166b1c7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:02.452928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5809def6-be9a-4d39-a411-650c4bc21be7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:02.460027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5266fb46-0348-4518-b351-07ac9166b1c7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1249 microversion: 2.1 time: 0.151198 May 26 12:50:02.461027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 140/294] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:02 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1249 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:02.468143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5809def6-be9a-4d39-a411-650c4bc21be7 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1274 microversion: 2.1 time: 0.119047 May 26 12:50:02.468959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 155/295] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:02 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:03.408523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-59ba9705-1c67-44b0-ad4a-94320ba17d1d req-099c34e3-f3c6-448f-9f20-35e6ac792a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64085992-ecfa-4fbc-a713-04aff66c0042", "tag": "1099ed7a-51bc-411b-8a61-ea93c6361abe"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:03.418414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-59ba9705-1c67-44b0-ad4a-94320ba17d1d req-099c34e3-f3c6-448f-9f20-35e6ac792a1b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.419060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-59ba9705-1c67-44b0-ad4a-94320ba17d1d req-099c34e3-f3c6-448f-9f20-35e6ac792a1b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.432378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-59ba9705-1c67-44b0-ad4a-94320ba17d1d req-099c34e3-f3c6-448f-9f20-35e6ac792a1b service nova] Creating event network-changed:1099ed7a-51bc-411b-8a61-ea93c6361abe for instance 64085992-ecfa-4fbc-a713-04aff66c0042 on hv-cinder-81514 May 26 12:50:03.438174 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-59ba9705-1c67-44b0-ad4a-94320ba17d1d req-099c34e3-f3c6-448f-9f20-35e6ac792a1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033385 May 26 12:50:03.439024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 141/296] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:03.477184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e8a064f7-88f7-405e-8e85-03b5450ae350 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:03.477811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e8a064f7-88f7-405e-8e85-03b5450ae350 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:03.485590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8a064f7-88f7-405e-8e85-03b5450ae350 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.486402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8a064f7-88f7-405e-8e85-03b5450ae350 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.487467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8a064f7-88f7-405e-8e85-03b5450ae350 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.488178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8a064f7-88f7-405e-8e85-03b5450ae350 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.489291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72c82309-b636-46c3-a585-f3520d9a3c6d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:03.491417 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72c82309-b636-46c3-a585-f3520d9a3c6d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:03.500206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c82309-b636-46c3-a585-f3520d9a3c6d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.500675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c82309-b636-46c3-a585-f3520d9a3c6d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.523096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c82309-b636-46c3-a585-f3520d9a3c6d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.523096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c82309-b636-46c3-a585-f3520d9a3c6d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.561593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e8a064f7-88f7-405e-8e85-03b5450ae350 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:03.577288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e8a064f7-88f7-405e-8e85-03b5450ae350 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1249 microversion: 2.1 time: 0.103794 May 26 12:50:03.591071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 156/297] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:03 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:03.593099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72c82309-b636-46c3-a585-f3520d9a3c6d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:03.607141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72c82309-b636-46c3-a585-f3520d9a3c6d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1274 microversion: 2.1 time: 0.122273 May 26 12:50:03.608147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 142/298] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:03 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:04.600409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52152c74-8d94-4e34-9c28-324054522c27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:04.601065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52152c74-8d94-4e34-9c28-324054522c27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:04.624547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52152c74-8d94-4e34-9c28-324054522c27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.625027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52152c74-8d94-4e34-9c28-324054522c27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.625944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52152c74-8d94-4e34-9c28-324054522c27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.626460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52152c74-8d94-4e34-9c28-324054522c27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.627719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5ae6e73-13ab-4d75-ba7e-6581a81dff81 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:04.628345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5ae6e73-13ab-4d75-ba7e-6581a81dff81 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:04.638764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5ae6e73-13ab-4d75-ba7e-6581a81dff81 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.640122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5ae6e73-13ab-4d75-ba7e-6581a81dff81 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.640920 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5ae6e73-13ab-4d75-ba7e-6581a81dff81 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.641367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5ae6e73-13ab-4d75-ba7e-6581a81dff81 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.703304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52152c74-8d94-4e34-9c28-324054522c27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:04.712324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52152c74-8d94-4e34-9c28-324054522c27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1249 microversion: 2.1 time: 0.120525 May 26 12:50:04.713326 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 157/299] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:04 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1249 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:04.760841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f5ae6e73-13ab-4d75-ba7e-6581a81dff81 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:04.769511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5ae6e73-13ab-4d75-ba7e-6581a81dff81 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1274 microversion: 2.1 time: 0.145859 May 26 12:50:04.770747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 143/300] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:04 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:05.729953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efe8da7b-273e-4c98-81d9-d3b7fc670cbf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:05.730601 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efe8da7b-273e-4c98-81d9-d3b7fc670cbf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:05.736820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efe8da7b-273e-4c98-81d9-d3b7fc670cbf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.737274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efe8da7b-273e-4c98-81d9-d3b7fc670cbf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.738243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efe8da7b-273e-4c98-81d9-d3b7fc670cbf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.738883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efe8da7b-273e-4c98-81d9-d3b7fc670cbf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.787981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-18a8e00e-3fa0-4d16-9c1e-07f444c9f384 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:05.789265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-18a8e00e-3fa0-4d16-9c1e-07f444c9f384 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:05.799978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18a8e00e-3fa0-4d16-9c1e-07f444c9f384 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.800773 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18a8e00e-3fa0-4d16-9c1e-07f444c9f384 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.801850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18a8e00e-3fa0-4d16-9c1e-07f444c9f384 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.802615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18a8e00e-3fa0-4d16-9c1e-07f444c9f384 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.807501 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-efe8da7b-273e-4c98-81d9-d3b7fc670cbf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:05.816308 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efe8da7b-273e-4c98-81d9-d3b7fc670cbf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1249 microversion: 2.1 time: 0.090179 May 26 12:50:05.822870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 158/301] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:05 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:05.843704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:05.961187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-18a8e00e-3fa0-4d16-9c1e-07f444c9f384 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:05.970807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-18a8e00e-3fa0-4d16-9c1e-07f444c9f384 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1284 microversion: 2.1 time: 0.186410 May 26 12:50:05.972080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 144/302] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:05 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:06.848029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7199bf95-676a-4715-ba7a-c3596132248b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:06.848029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7199bf95-676a-4715-ba7a-c3596132248b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:06.859712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7199bf95-676a-4715-ba7a-c3596132248b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.860463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7199bf95-676a-4715-ba7a-c3596132248b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.863112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7199bf95-676a-4715-ba7a-c3596132248b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.864356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7199bf95-676a-4715-ba7a-c3596132248b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.995666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c83b530c-72f9-4457-811d-1ee121971c8f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:06.996396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c83b530c-72f9-4457-811d-1ee121971c8f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:07.011535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c83b530c-72f9-4457-811d-1ee121971c8f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.012259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c83b530c-72f9-4457-811d-1ee121971c8f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.022563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c83b530c-72f9-4457-811d-1ee121971c8f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.024480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c83b530c-72f9-4457-811d-1ee121971c8f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.048660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7199bf95-676a-4715-ba7a-c3596132248b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:07.065281 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7199bf95-676a-4715-ba7a-c3596132248b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1297 microversion: 2.1 time: 0.227173 May 26 12:50:07.067945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 159/303] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:06 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1297 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:07.152477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c83b530c-72f9-4457-811d-1ee121971c8f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:07.170071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c83b530c-72f9-4457-811d-1ee121971c8f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1272 microversion: 2.1 time: 0.184158 May 26 12:50:07.171392 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 145/304] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:06 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:08.085518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4fd1e87f-d8de-4b78-bb8a-9ecb7c70b1b7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:08.086475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4fd1e87f-d8de-4b78-bb8a-9ecb7c70b1b7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:08.096653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd1e87f-d8de-4b78-bb8a-9ecb7c70b1b7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.097318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd1e87f-d8de-4b78-bb8a-9ecb7c70b1b7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.098239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd1e87f-d8de-4b78-bb8a-9ecb7c70b1b7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.098976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd1e87f-d8de-4b78-bb8a-9ecb7c70b1b7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.127494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:08.190081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4fd1e87f-d8de-4b78-bb8a-9ecb7c70b1b7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:08.190636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f595360-3d50-4167-b93c-a352e984cc9e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:08.191250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f595360-3d50-4167-b93c-a352e984cc9e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:08.196077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:08.206038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4fd1e87f-d8de-4b78-bb8a-9ecb7c70b1b7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1303 microversion: 2.1 time: 0.126620 May 26 12:50:08.206795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 160/305] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:08 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:08.211825 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f595360-3d50-4167-b93c-a352e984cc9e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.217280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f595360-3d50-4167-b93c-a352e984cc9e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.217280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f595360-3d50-4167-b93c-a352e984cc9e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.217280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f595360-3d50-4167-b93c-a352e984cc9e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.904898 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f595360-3d50-4167-b93c-a352e984cc9e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:08.917651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f595360-3d50-4167-b93c-a352e984cc9e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.731771 May 26 12:50:08.923351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 146/306] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:08 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:09.226361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6d14f5b-4a78-4801-b66b-b6165842ef02 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:09.227692 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6d14f5b-4a78-4801-b66b-b6165842ef02 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:09.243931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6d14f5b-4a78-4801-b66b-b6165842ef02 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.244541 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6d14f5b-4a78-4801-b66b-b6165842ef02 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.245955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6d14f5b-4a78-4801-b66b-b6165842ef02 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.245955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6d14f5b-4a78-4801-b66b-b6165842ef02 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.763378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:09.939741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fdb28390-d3b6-4514-a7c9-57ef095e792f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:09.942902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fdb28390-d3b6-4514-a7c9-57ef095e792f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:09.951300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6d14f5b-4a78-4801-b66b-b6165842ef02 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:09.964071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6d14f5b-4a78-4801-b66b-b6165842ef02 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.741880 May 26 12:50:09.964657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 161/307] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:09 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:09.976048 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:09.979947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdb28390-d3b6-4514-a7c9-57ef095e792f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.985427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdb28390-d3b6-4514-a7c9-57ef095e792f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.986693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdb28390-d3b6-4514-a7c9-57ef095e792f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.986921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdb28390-d3b6-4514-a7c9-57ef095e792f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:10.315728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-d1564d64-d8a5-4435-ad4a-51fb275d0155 req-fd160e6f-9e21-430c-8709-c748fdb4bfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb2a7865-19c3-4a61-8b0a-a8e255f11493", "tag": "3a0de8a2-9d24-4431-860a-89cccc76a4cb"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:10.325691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=14 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:10.329985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d1564d64-d8a5-4435-ad4a-51fb275d0155 req-fd160e6f-9e21-430c-8709-c748fdb4bfac service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:10.331166 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d1564d64-d8a5-4435-ad4a-51fb275d0155 req-fd160e6f-9e21-430c-8709-c748fdb4bfac service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:10.353660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-d1564d64-d8a5-4435-ad4a-51fb275d0155 req-fd160e6f-9e21-430c-8709-c748fdb4bfac service nova] Creating event network-changed:3a0de8a2-9d24-4431-860a-89cccc76a4cb for instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 on hv-cinder-81514 May 26 12:50:10.361547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-d1564d64-d8a5-4435-ad4a-51fb275d0155 req-fd160e6f-9e21-430c-8709-c748fdb4bfac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050869 May 26 12:50:10.362139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 162/308] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:50:10.635703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fdb28390-d3b6-4514-a7c9-57ef095e792f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:10.646697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fdb28390-d3b6-4514-a7c9-57ef095e792f tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.709810 May 26 12:50:10.649757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 147/309] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:09 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:10.986460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-572e3a94-e2da-4e3c-b66a-b91c936f67be tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:10.987834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-572e3a94-e2da-4e3c-b66a-b91c936f67be tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:11.006650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-572e3a94-e2da-4e3c-b66a-b91c936f67be tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.007924 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-572e3a94-e2da-4e3c-b66a-b91c936f67be tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.009021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-572e3a94-e2da-4e3c-b66a-b91c936f67be tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.011160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-572e3a94-e2da-4e3c-b66a-b91c936f67be tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.559900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-572e3a94-e2da-4e3c-b66a-b91c936f67be tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:11.576707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-572e3a94-e2da-4e3c-b66a-b91c936f67be tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.596219 May 26 12:50:11.580297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 163/310] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:10 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:11.668084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c565db4-0593-43bb-b953-91b2ce724e05 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:11.670913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c565db4-0593-43bb-b953-91b2ce724e05 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:11.682930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c565db4-0593-43bb-b953-91b2ce724e05 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.685050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c565db4-0593-43bb-b953-91b2ce724e05 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.687803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c565db4-0593-43bb-b953-91b2ce724e05 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.689569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c565db4-0593-43bb-b953-91b2ce724e05 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.053302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c565db4-0593-43bb-b953-91b2ce724e05 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:12.061525 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c565db4-0593-43bb-b953-91b2ce724e05 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.397623 May 26 12:50:12.073145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 148/311] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:11 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:12.403389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-f4bb69c8-c1ad-4f8d-9b79-c5d24ad0dcdc req-bd508a7d-39cc-4813-ae4f-880bddea1184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec", "tag": "159cee84-406e-4fca-9ca2-17925ac974a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:12.416491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f4bb69c8-c1ad-4f8d-9b79-c5d24ad0dcdc req-bd508a7d-39cc-4813-ae4f-880bddea1184 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.417299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f4bb69c8-c1ad-4f8d-9b79-c5d24ad0dcdc req-bd508a7d-39cc-4813-ae4f-880bddea1184 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.445255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-f4bb69c8-c1ad-4f8d-9b79-c5d24ad0dcdc req-bd508a7d-39cc-4813-ae4f-880bddea1184 service nova] Creating event network-changed:159cee84-406e-4fca-9ca2-17925ac974a1 for instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec on hv-cinder-81514 May 26 12:50:12.453512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-f4bb69c8-c1ad-4f8d-9b79-c5d24ad0dcdc req-bd508a7d-39cc-4813-ae4f-880bddea1184 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058414 May 26 12:50:12.454592 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 164/312] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:12.600100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-adfd1bd2-9afe-4602-b9a3-784d087a7121 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:12.600794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-adfd1bd2-9afe-4602-b9a3-784d087a7121 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:12.610978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adfd1bd2-9afe-4602-b9a3-784d087a7121 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.611443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adfd1bd2-9afe-4602-b9a3-784d087a7121 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.612775 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adfd1bd2-9afe-4602-b9a3-784d087a7121 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.613412 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adfd1bd2-9afe-4602-b9a3-784d087a7121 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.809350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-adfd1bd2-9afe-4602-b9a3-784d087a7121 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:12.829078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-adfd1bd2-9afe-4602-b9a3-784d087a7121 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.233735 May 26 12:50:12.829767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 149/313] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:12 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:13.081743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f4d0d05-0cc6-4367-b149-59a438028c67 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:13.083713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f4d0d05-0cc6-4367-b149-59a438028c67 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:13.100228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f4d0d05-0cc6-4367-b149-59a438028c67 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:13.105378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f4d0d05-0cc6-4367-b149-59a438028c67 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:13.106316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f4d0d05-0cc6-4367-b149-59a438028c67 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:13.106806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f4d0d05-0cc6-4367-b149-59a438028c67 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:13.226975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-67b3ab77-f8b8-4dfe-9d60-e252a2820f45 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Action: 'create', calling method: .version_select at 0x7f498c441e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1173115337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh0RR03+hf97g+qc53mN+y/Jxv8wfYcw7zWQ9SMnR6PHMJXfzlfWVUVUQ7SHZNe5ra3zjtIYDtH4zl7z1DFTYepa3uoiUiTcTpyTwnYBWmrMkMehvW8ER/phShi7/YMoQ=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:13.277826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-67b3ab77-f8b8-4dfe-9d60-e252a2820f45 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Getting quotas for project d6cc833734e44b588c6d0d52c3ca7b84. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:50:13.286659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-67b3ab77-f8b8-4dfe-9d60-e252a2820f45 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Getting quotas for user 160c6175803b45bf80591084ad4e92ba and project d6cc833734e44b588c6d0d52c3ca7b84. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:50:13.305131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f4d0d05-0cc6-4367-b149-59a438028c67 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:13.313865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f4d0d05-0cc6-4367-b149-59a438028c67 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.238815 May 26 12:50:13.314785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 150/314] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:13 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:13.479169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-67b3ab77-f8b8-4dfe-9d60-e252a2820f45 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.573486 May 26 12:50:13.479791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 165/315] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 12:50:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:13.847492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c847655f-3490-4fe9-bfea-a190de995d27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:13.848882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c847655f-3490-4fe9-bfea-a190de995d27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:13.855512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c847655f-3490-4fe9-bfea-a190de995d27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:13.856002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c847655f-3490-4fe9-bfea-a190de995d27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:13.856750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c847655f-3490-4fe9-bfea-a190de995d27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:13.857204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c847655f-3490-4fe9-bfea-a190de995d27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:14.023335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c847655f-3490-4fe9-bfea-a190de995d27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:14.030865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c847655f-3490-4fe9-bfea-a190de995d27 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.187110 May 26 12:50:14.031436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 151/316] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:13 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:14.340107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d0f435f0-547c-43fa-ae01-e6d9c2b9f272 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:14.342044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d0f435f0-547c-43fa-ae01-e6d9c2b9f272 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:14.349778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0f435f0-547c-43fa-ae01-e6d9c2b9f272 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:14.350397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0f435f0-547c-43fa-ae01-e6d9c2b9f272 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:14.351461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0f435f0-547c-43fa-ae01-e6d9c2b9f272 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:14.351947 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0f435f0-547c-43fa-ae01-e6d9c2b9f272 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:14.527221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0f435f0-547c-43fa-ae01-e6d9c2b9f272 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:14.537078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d0f435f0-547c-43fa-ae01-e6d9c2b9f272 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.205033 May 26 12:50:14.546881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 166/317] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:14 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:15.048811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2e087bb-8680-4569-8e51-69a6fac774e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:15.049376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2e087bb-8680-4569-8e51-69a6fac774e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:15.056945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2e087bb-8680-4569-8e51-69a6fac774e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:15.057395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2e087bb-8680-4569-8e51-69a6fac774e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:15.058302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2e087bb-8680-4569-8e51-69a6fac774e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:15.058992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2e087bb-8680-4569-8e51-69a6fac774e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:15.238350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2e087bb-8680-4569-8e51-69a6fac774e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:15.246235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2e087bb-8680-4569-8e51-69a6fac774e4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.201604 May 26 12:50:15.256121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 152/318] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:15 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:15.557524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce624872-41cf-42c0-b15c-67b045c97159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:15.561997 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce624872-41cf-42c0-b15c-67b045c97159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:15.567234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce624872-41cf-42c0-b15c-67b045c97159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:15.567956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce624872-41cf-42c0-b15c-67b045c97159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:15.572368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce624872-41cf-42c0-b15c-67b045c97159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:15.572988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce624872-41cf-42c0-b15c-67b045c97159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:15.771429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ce624872-41cf-42c0-b15c-67b045c97159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:15.782305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce624872-41cf-42c0-b15c-67b045c97159 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.232074 May 26 12:50:15.793868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 167/319] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:15 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:16.270403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d007956b-5949-40ca-aaaa-20129354c6ba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:16.271799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d007956b-5949-40ca-aaaa-20129354c6ba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:16.282934 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d007956b-5949-40ca-aaaa-20129354c6ba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:16.290449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d007956b-5949-40ca-aaaa-20129354c6ba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:16.291441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d007956b-5949-40ca-aaaa-20129354c6ba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:16.292955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d007956b-5949-40ca-aaaa-20129354c6ba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:16.624261 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d007956b-5949-40ca-aaaa-20129354c6ba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:16.633504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d007956b-5949-40ca-aaaa-20129354c6ba tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.371865 May 26 12:50:16.634944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 153/320] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:16 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:16.810047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee208e4c-1212-4846-aedf-16d561c37b92 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:16.810823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee208e4c-1212-4846-aedf-16d561c37b92 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:16.829514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:16.832588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee208e4c-1212-4846-aedf-16d561c37b92 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:16.833554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee208e4c-1212-4846-aedf-16d561c37b92 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:16.835169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee208e4c-1212-4846-aedf-16d561c37b92 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:16.835873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee208e4c-1212-4846-aedf-16d561c37b92 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.413671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee208e4c-1212-4846-aedf-16d561c37b92 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:17.429602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee208e4c-1212-4846-aedf-16d561c37b92 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.625018 May 26 12:50:17.430189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 168/321] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:16 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:17.653628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89ff5017-81fc-4a5f-975f-f2973faff483 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:17.655144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89ff5017-81fc-4a5f-975f-f2973faff483 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:17.666118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89ff5017-81fc-4a5f-975f-f2973faff483 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.667913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89ff5017-81fc-4a5f-975f-f2973faff483 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.668835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89ff5017-81fc-4a5f-975f-f2973faff483 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.669854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89ff5017-81fc-4a5f-975f-f2973faff483 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.824498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89ff5017-81fc-4a5f-975f-f2973faff483 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:17.834932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89ff5017-81fc-4a5f-975f-f2973faff483 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.187488 May 26 12:50:17.838696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 154/322] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:17 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:18.447290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-551079ce-dd3d-4c3d-bf42-fc211805d6f6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:18.447943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-551079ce-dd3d-4c3d-bf42-fc211805d6f6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:18.465112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-551079ce-dd3d-4c3d-bf42-fc211805d6f6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.465471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-551079ce-dd3d-4c3d-bf42-fc211805d6f6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.466252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-551079ce-dd3d-4c3d-bf42-fc211805d6f6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.466818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-551079ce-dd3d-4c3d-bf42-fc211805d6f6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.719328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-551079ce-dd3d-4c3d-bf42-fc211805d6f6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:18.733221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-551079ce-dd3d-4c3d-bf42-fc211805d6f6 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.290229 May 26 12:50:18.734430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 169/323] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:18 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:18.852780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-836bc486-72ee-4d4c-a4b2-7c870e98eac8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:18.853392 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-836bc486-72ee-4d4c-a4b2-7c870e98eac8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:18.860055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-836bc486-72ee-4d4c-a4b2-7c870e98eac8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.860501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-836bc486-72ee-4d4c-a4b2-7c870e98eac8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.861486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-836bc486-72ee-4d4c-a4b2-7c870e98eac8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.861921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-836bc486-72ee-4d4c-a4b2-7c870e98eac8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.121207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-836bc486-72ee-4d4c-a4b2-7c870e98eac8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:19.135719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-836bc486-72ee-4d4c-a4b2-7c870e98eac8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.286469 May 26 12:50:19.137190 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 155/324] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:18 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:19.751162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e2dd001-700a-4f7c-a601-37468c576e48 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:19.752224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e2dd001-700a-4f7c-a601-37468c576e48 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:19.760705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e2dd001-700a-4f7c-a601-37468c576e48 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:19.761156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e2dd001-700a-4f7c-a601-37468c576e48 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.763525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e2dd001-700a-4f7c-a601-37468c576e48 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:19.764837 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e2dd001-700a-4f7c-a601-37468c576e48 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.950082 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9e2dd001-700a-4f7c-a601-37468c576e48 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:19.959821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e2dd001-700a-4f7c-a601-37468c576e48 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.213026 May 26 12:50:19.960699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 170/325] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:19 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:20.159283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5787c84c-0321-4f61-9cd9-24b74e5be5d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:20.160623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5787c84c-0321-4f61-9cd9-24b74e5be5d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:20.168126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5787c84c-0321-4f61-9cd9-24b74e5be5d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.168909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5787c84c-0321-4f61-9cd9-24b74e5be5d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.169846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5787c84c-0321-4f61-9cd9-24b74e5be5d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.170592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5787c84c-0321-4f61-9cd9-24b74e5be5d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.429600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5787c84c-0321-4f61-9cd9-24b74e5be5d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:20.437936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5787c84c-0321-4f61-9cd9-24b74e5be5d7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.285921 May 26 12:50:20.438510 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 156/326] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:20 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:20.977645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a1e59b58-ad47-43ee-a01f-befd8dc36342 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:20.978278 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a1e59b58-ad47-43ee-a01f-befd8dc36342 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:20.993084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1e59b58-ad47-43ee-a01f-befd8dc36342 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.993761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1e59b58-ad47-43ee-a01f-befd8dc36342 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.994422 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1e59b58-ad47-43ee-a01f-befd8dc36342 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.994899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1e59b58-ad47-43ee-a01f-befd8dc36342 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.170493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a1e59b58-ad47-43ee-a01f-befd8dc36342 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:21.181852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a1e59b58-ad47-43ee-a01f-befd8dc36342 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.207828 May 26 12:50:21.191932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 171/327] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:20 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:21.358145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-a3e758ee-bbe7-45a7-bf1f-bf2436e972e9 req-14a31481-f243-4347-8007-1d0373ac7f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2a7865-19c3-4a61-8b0a-a8e255f11493", "name": "network-vif-plugged", "status": "completed", "tag": "3a0de8a2-9d24-4431-860a-89cccc76a4cb"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:21.369180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a3e758ee-bbe7-45a7-bf1f-bf2436e972e9 req-14a31481-f243-4347-8007-1d0373ac7f7e service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.369883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a3e758ee-bbe7-45a7-bf1f-bf2436e972e9 req-14a31481-f243-4347-8007-1d0373ac7f7e service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.387688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-a3e758ee-bbe7-45a7-bf1f-bf2436e972e9 req-14a31481-f243-4347-8007-1d0373ac7f7e service nova] Creating event network-vif-plugged:3a0de8a2-9d24-4431-860a-89cccc76a4cb for instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 on hv-cinder-81514 May 26 12:50:21.394251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-a3e758ee-bbe7-45a7-bf1f-bf2436e972e9 req-14a31481-f243-4347-8007-1d0373ac7f7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040759 May 26 12:50:21.395146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 157/328] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:21.457086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7c5d0bf2-a11c-40ce-a53e-912351644396 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:21.458409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7c5d0bf2-a11c-40ce-a53e-912351644396 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:21.467970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c5d0bf2-a11c-40ce-a53e-912351644396 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.468722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c5d0bf2-a11c-40ce-a53e-912351644396 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.471573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c5d0bf2-a11c-40ce-a53e-912351644396 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.478405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c5d0bf2-a11c-40ce-a53e-912351644396 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.669724 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c5d0bf2-a11c-40ce-a53e-912351644396 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:21.685643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7c5d0bf2-a11c-40ce-a53e-912351644396 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.233711 May 26 12:50:21.687215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 172/329] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:21 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:22.200314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-58cb203b-dd4a-4c4b-a24b-b86ab8b915ba tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:22.201093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-58cb203b-dd4a-4c4b-a24b-b86ab8b915ba tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:22.207723 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58cb203b-dd4a-4c4b-a24b-b86ab8b915ba tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.208182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58cb203b-dd4a-4c4b-a24b-b86ab8b915ba tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.208955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58cb203b-dd4a-4c4b-a24b-b86ab8b915ba tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.209397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58cb203b-dd4a-4c4b-a24b-b86ab8b915ba tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.351810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-58cb203b-dd4a-4c4b-a24b-b86ab8b915ba tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:22.360112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-58cb203b-dd4a-4c4b-a24b-b86ab8b915ba tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.164181 May 26 12:50:22.360700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 158/330] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:22 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:22.707105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f8b7e3b-3623-4ec1-a37f-7cfc3301999e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:22.707743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f8b7e3b-3623-4ec1-a37f-7cfc3301999e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:22.714147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f8b7e3b-3623-4ec1-a37f-7cfc3301999e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.714821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f8b7e3b-3623-4ec1-a37f-7cfc3301999e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.715755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f8b7e3b-3623-4ec1-a37f-7cfc3301999e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.716373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f8b7e3b-3623-4ec1-a37f-7cfc3301999e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.983619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f8b7e3b-3623-4ec1-a37f-7cfc3301999e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:22.992623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f8b7e3b-3623-4ec1-a37f-7cfc3301999e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.292143 May 26 12:50:22.993378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 173/331] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:22 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:23.380127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6fd61d65-42f9-4d12-843e-4c2e20461974 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:23.381055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6fd61d65-42f9-4d12-843e-4c2e20461974 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:23.391361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fd61d65-42f9-4d12-843e-4c2e20461974 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:23.391361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fd61d65-42f9-4d12-843e-4c2e20461974 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:23.392090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fd61d65-42f9-4d12-843e-4c2e20461974 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:23.392685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fd61d65-42f9-4d12-843e-4c2e20461974 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:23.570052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6fd61d65-42f9-4d12-843e-4c2e20461974 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:23.578453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6fd61d65-42f9-4d12-843e-4c2e20461974 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1314 microversion: 2.1 time: 0.204114 May 26 12:50:23.579497 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 159/332] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:23 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:24.009884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3f951458-36ff-4313-8a69-46a9de84a85a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:24.010500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3f951458-36ff-4313-8a69-46a9de84a85a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:24.012483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:24.017863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f951458-36ff-4313-8a69-46a9de84a85a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.018668 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f951458-36ff-4313-8a69-46a9de84a85a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.019461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f951458-36ff-4313-8a69-46a9de84a85a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.019903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f951458-36ff-4313-8a69-46a9de84a85a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.189712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3f951458-36ff-4313-8a69-46a9de84a85a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:24.209979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3f951458-36ff-4313-8a69-46a9de84a85a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.193212 May 26 12:50:24.209979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 174/333] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:24 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:24.599633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c01c8469-aa34-4344-adfd-3f9d28c13789 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:24.600987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c01c8469-aa34-4344-adfd-3f9d28c13789 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:24.609137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c01c8469-aa34-4344-adfd-3f9d28c13789 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.609929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c01c8469-aa34-4344-adfd-3f9d28c13789 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.611869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c01c8469-aa34-4344-adfd-3f9d28c13789 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.612413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c01c8469-aa34-4344-adfd-3f9d28c13789 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.861323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c01c8469-aa34-4344-adfd-3f9d28c13789 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:24.880342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c01c8469-aa34-4344-adfd-3f9d28c13789 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1463 microversion: 2.1 time: 0.287955 May 26 12:50:24.890823 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 160/334] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:24 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1463 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:24.945585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bbdbb342-bdb5-4749-83c7-34b2c2fb1724 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:24.946093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bbdbb342-bdb5-4749-83c7-34b2c2fb1724 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:24.953536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbdbb342-bdb5-4749-83c7-34b2c2fb1724 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.954067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbdbb342-bdb5-4749-83c7-34b2c2fb1724 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.954960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbdbb342-bdb5-4749-83c7-34b2c2fb1724 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.955749 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbdbb342-bdb5-4749-83c7-34b2c2fb1724 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.984600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bbdbb342-bdb5-4749-83c7-34b2c2fb1724 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:50:25.218011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-188f6bdc-c21e-4ce4-a493-ce331dc04576 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:25.218657 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-188f6bdc-c21e-4ce4-a493-ce331dc04576 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:25.241036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-188f6bdc-c21e-4ce4-a493-ce331dc04576 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.241574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-188f6bdc-c21e-4ce4-a493-ce331dc04576 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.242638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-188f6bdc-c21e-4ce4-a493-ce331dc04576 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.243244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-188f6bdc-c21e-4ce4-a493-ce331dc04576 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.388756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bbdbb342-bdb5-4749-83c7-34b2c2fb1724 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 204 len: 0 microversion: 2.1 time: 0.447852 May 26 12:50:25.393762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 175/335] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:50:24 2022] DELETE /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:50:25.399377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1a02469-543f-4e79-9ab8-4fc689c8620e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:25.400112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1a02469-543f-4e79-9ab8-4fc689c8620e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:25.406629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1a02469-543f-4e79-9ab8-4fc689c8620e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.407075 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1a02469-543f-4e79-9ab8-4fc689c8620e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.408112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1a02469-543f-4e79-9ab8-4fc689c8620e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.409234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1a02469-543f-4e79-9ab8-4fc689c8620e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.572552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-188f6bdc-c21e-4ce4-a493-ce331dc04576 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:25.600546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:25.609578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-188f6bdc-c21e-4ce4-a493-ce331dc04576 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.395481 May 26 12:50:25.614162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 161/336] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:25 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:25.646768 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1a02469-543f-4e79-9ab8-4fc689c8620e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:25.658915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1a02469-543f-4e79-9ab8-4fc689c8620e tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1469 microversion: 2.1 time: 0.262480 May 26 12:50:25.667239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 176/337] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:25 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:26.630182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-740cf32a-6faa-44e1-94b3-d89105021f4d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:26.630837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-740cf32a-6faa-44e1-94b3-d89105021f4d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:26.651354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-740cf32a-6faa-44e1-94b3-d89105021f4d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:26.651981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-740cf32a-6faa-44e1-94b3-d89105021f4d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.668558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-740cf32a-6faa-44e1-94b3-d89105021f4d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:26.669020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-740cf32a-6faa-44e1-94b3-d89105021f4d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.677381 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae5da1e0-680d-4e71-8a68-9daa66cf334d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:26.678774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae5da1e0-680d-4e71-8a68-9daa66cf334d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:26.690073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae5da1e0-680d-4e71-8a68-9daa66cf334d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:26.692731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae5da1e0-680d-4e71-8a68-9daa66cf334d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.695715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae5da1e0-680d-4e71-8a68-9daa66cf334d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:26.697970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae5da1e0-680d-4e71-8a68-9daa66cf334d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.726329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:27.045922 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae5da1e0-680d-4e71-8a68-9daa66cf334d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:27.059606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae5da1e0-680d-4e71-8a68-9daa66cf334d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1469 microversion: 2.1 time: 0.385209 May 26 12:50:27.070832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 177/338] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:26 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1469 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:27.246947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-740cf32a-6faa-44e1-94b3-d89105021f4d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:27.255294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-740cf32a-6faa-44e1-94b3-d89105021f4d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.629860 May 26 12:50:27.255895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 162/339] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:26 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:27.531730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-be4e2c6d-72d6-4133-b514-d406acb76ae1 req-695f7b7e-03a2-40a8-99d4-4aafaa5fa67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec", "name": "network-vif-plugged", "status": "completed", "tag": "159cee84-406e-4fca-9ca2-17925ac974a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:27.546962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-be4e2c6d-72d6-4133-b514-d406acb76ae1 req-695f7b7e-03a2-40a8-99d4-4aafaa5fa67b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:27.550902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-be4e2c6d-72d6-4133-b514-d406acb76ae1 req-695f7b7e-03a2-40a8-99d4-4aafaa5fa67b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:27.588534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-be4e2c6d-72d6-4133-b514-d406acb76ae1 req-695f7b7e-03a2-40a8-99d4-4aafaa5fa67b service nova] Creating event network-vif-plugged:159cee84-406e-4fca-9ca2-17925ac974a1 for instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec on hv-cinder-81514 May 26 12:50:27.594348 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-be4e2c6d-72d6-4133-b514-d406acb76ae1 req-695f7b7e-03a2-40a8-99d4-4aafaa5fa67b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066309 May 26 12:50:27.600591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 178/340] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:28.075987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19cdcaba-ae45-46ed-b5db-5b5c07398b03 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:28.076710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19cdcaba-ae45-46ed-b5db-5b5c07398b03 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:28.095717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19cdcaba-ae45-46ed-b5db-5b5c07398b03 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.096179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19cdcaba-ae45-46ed-b5db-5b5c07398b03 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.096977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19cdcaba-ae45-46ed-b5db-5b5c07398b03 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.097421 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19cdcaba-ae45-46ed-b5db-5b5c07398b03 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.275179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be074b40-6f44-41e1-b051-cb8fd0458441 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:28.282848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be074b40-6f44-41e1-b051-cb8fd0458441 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:28.291413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be074b40-6f44-41e1-b051-cb8fd0458441 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.292895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be074b40-6f44-41e1-b051-cb8fd0458441 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.293328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be074b40-6f44-41e1-b051-cb8fd0458441 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.293931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be074b40-6f44-41e1-b051-cb8fd0458441 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.442155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be074b40-6f44-41e1-b051-cb8fd0458441 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:28.450411 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be074b40-6f44-41e1-b051-cb8fd0458441 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.180692 May 26 12:50:28.451071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 179/341] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:28 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:28.596608 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19cdcaba-ae45-46ed-b5db-5b5c07398b03 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:28.605479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19cdcaba-ae45-46ed-b5db-5b5c07398b03 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1469 microversion: 2.1 time: 0.533444 May 26 12:50:28.606283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 163/342] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:28 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1469 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:29.108132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-bc8524fe-6c5a-486c-bb10-15a876c1562e req-34112477-36c0-44fe-8054-aaff8722bb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2a7865-19c3-4a61-8b0a-a8e255f11493", "name": "network-vif-deleted", "tag": "3a0de8a2-9d24-4431-860a-89cccc76a4cb"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:29.117110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-bc8524fe-6c5a-486c-bb10-15a876c1562e req-34112477-36c0-44fe-8054-aaff8722bb8c service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.117564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-bc8524fe-6c5a-486c-bb10-15a876c1562e req-34112477-36c0-44fe-8054-aaff8722bb8c service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.146212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-bc8524fe-6c5a-486c-bb10-15a876c1562e req-34112477-36c0-44fe-8054-aaff8722bb8c service nova] Creating event network-vif-deleted:3a0de8a2-9d24-4431-860a-89cccc76a4cb for instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 on hv-cinder-81514 May 26 12:50:29.154511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-bc8524fe-6c5a-486c-bb10-15a876c1562e req-34112477-36c0-44fe-8054-aaff8722bb8c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049612 May 26 12:50:29.162433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 180/343] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:29.467402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-73f61de9-36c8-489e-9889-0544487d26f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:29.468022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-73f61de9-36c8-489e-9889-0544487d26f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:29.475773 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73f61de9-36c8-489e-9889-0544487d26f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.477325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73f61de9-36c8-489e-9889-0544487d26f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.477325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73f61de9-36c8-489e-9889-0544487d26f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.477815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73f61de9-36c8-489e-9889-0544487d26f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.625171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-529e8ab4-a9fd-45e8-90d2-7c16afbda958 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:29.626677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-529e8ab4-a9fd-45e8-90d2-7c16afbda958 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:29.637745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-529e8ab4-a9fd-45e8-90d2-7c16afbda958 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.638504 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-529e8ab4-a9fd-45e8-90d2-7c16afbda958 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.640238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-529e8ab4-a9fd-45e8-90d2-7c16afbda958 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.640683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-529e8ab4-a9fd-45e8-90d2-7c16afbda958 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.699639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-73f61de9-36c8-489e-9889-0544487d26f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:29.708641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-73f61de9-36c8-489e-9889-0544487d26f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.245155 May 26 12:50:29.710130 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 164/344] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:29 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:29.715713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-529e8ab4-a9fd-45e8-90d2-7c16afbda958 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:29.726624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-529e8ab4-a9fd-45e8-90d2-7c16afbda958 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1299 microversion: 2.1 time: 0.105806 May 26 12:50:29.728470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 181/345] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:29 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:30.727219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d2fc63a-0ff5-4f98-8be3-140a53f17619 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:30.728164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d2fc63a-0ff5-4f98-8be3-140a53f17619 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:30.735488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d2fc63a-0ff5-4f98-8be3-140a53f17619 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.735943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d2fc63a-0ff5-4f98-8be3-140a53f17619 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.736741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d2fc63a-0ff5-4f98-8be3-140a53f17619 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.737168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d2fc63a-0ff5-4f98-8be3-140a53f17619 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.745016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:30.745639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:30.752856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.755923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.755923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.755923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.818152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.819066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.819684 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lazy-loading 'fault' on Instance uuid bb2a7865-19c3-4a61-8b0a-a8e255f11493 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:30.865690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:30.880268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-739df628-13c7-4073-a20f-5ff639c5940d tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1304 microversion: 2.1 time: 0.134705 May 26 12:50:30.880268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 182/346] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:30 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:30.976996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d2fc63a-0ff5-4f98-8be3-140a53f17619 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:30.986892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d2fc63a-0ff5-4f98-8be3-140a53f17619 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1371 microversion: 2.1 time: 0.263586 May 26 12:50:30.997271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 165/347] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:30 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:31.902711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:31.903962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:31.913834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.914225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.915213 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.915650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.950109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.950698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.951220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lazy-loading 'fault' on Instance uuid bb2a7865-19c3-4a61-8b0a-a8e255f11493 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:32.002889 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b760cb7932fc4b3ea0d3e7526f15be0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:32.005465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7d8f993-6b68-4a1c-8a5b-aa94c75fe3df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:32.006073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7d8f993-6b68-4a1c-8a5b-aa94c75fe3df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:32.013807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8417d011-9f0f-47f7-a134-558796cb0a08 tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 200 len: 1304 microversion: 2.1 time: 0.123972 May 26 12:50:32.017949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7d8f993-6b68-4a1c-8a5b-aa94c75fe3df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.017949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7d8f993-6b68-4a1c-8a5b-aa94c75fe3df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.023245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 183/348] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:31 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:32.025206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7d8f993-6b68-4a1c-8a5b-aa94c75fe3df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.025690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7d8f993-6b68-4a1c-8a5b-aa94c75fe3df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.185517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7d8f993-6b68-4a1c-8a5b-aa94c75fe3df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:32.195398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7d8f993-6b68-4a1c-8a5b-aa94c75fe3df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1566 microversion: 2.1 time: 0.194185 May 26 12:50:32.221605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 166/349] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:31 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:32.228265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4917b4ec-7737-43c6-a145-f8a9a1a9d0e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:32.228986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4917b4ec-7737-43c6-a145-f8a9a1a9d0e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:32.238028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4917b4ec-7737-43c6-a145-f8a9a1a9d0e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.238779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4917b4ec-7737-43c6-a145-f8a9a1a9d0e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.239732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4917b4ec-7737-43c6-a145-f8a9a1a9d0e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.240965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4917b4ec-7737-43c6-a145-f8a9a1a9d0e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.331831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4917b4ec-7737-43c6-a145-f8a9a1a9d0e7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107733 May 26 12:50:32.332688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 184/350] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 26 12:50:32 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:33.034958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:33.037384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] [instance: bb2a7865-19c3-4a61-8b0a-a8e255f11493] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:33.062364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:33.063260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.067322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:33.071323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.100303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] HTTP exception thrown: Instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 could not be found. May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Request method failure captured: May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 HTTP/1.1 May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3dwMHdZEpokXQp7XDVC1jTwYovTvaM2o-Mn9PMBd3W35qXyI6JQ-4qTVxaOjkyqMKLSdADwbviLYn6GCTiCiOCuo-KBnDf4qufeDX7IfFb-d9paFTdTTMqV7b5pWG1d6LqmYEkeDBrcTD1tWsN2epwX8JlqqQwmGgq_9VWChEBod0c May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: a4ab83dbdfb7409bbea3af2745c1ddaf May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-1985434803 May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:50:33.102901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a4ab83dbdfb7409bbea3af2745c1ddaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a4ab83dbdfb7409bbea3af2745c1ddaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a4ab83dbdfb7409bbea3af2745c1ddaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a4ab83dbdfb7409bbea3af2745c1ddaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-1985434803 May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: a4ab83dbdfb7409bbea3af2745c1ddaf May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-1985434803 May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-1985434803-project May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: b760cb7932fc4b3ea0d3e7526f15be0c May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-1985434803-project May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 could not be found. May 26 12:50:33.104809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': 'bb2a7865-19c3-4a61-8b0a-a8e255f11493'} May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 could not be found. May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:50:33.105729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 could not be found. May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 could not be found. May 26 12:50:33.107197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:50:33.116538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] Returning 404 to user: Instance bb2a7865-19c3-4a61-8b0a-a8e255f11493 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:50:33.127914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c69bb93-4838-4b8a-a76d-07f77e27611a tempest-VolumesNegativeTest-1985434803 tempest-VolumesNegativeTest-1985434803-project] 10.222.0.60 "GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493" status: 404 len: 111 microversion: 2.1 time: 0.089602 May 26 12:50:33.127914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 167/351] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:33 2022] GET /compute/v2.1/servers/bb2a7865-19c3-4a61-8b0a-a8e255f11493 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:50:34.353771 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-82999f7c-78b5-43cb-8034-19e8e4e0cf2f req-ebd91352-4fa7-42cf-b5ee-d71883ef25f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec", "tag": "159cee84-406e-4fca-9ca2-17925ac974a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:34.375630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-82999f7c-78b5-43cb-8034-19e8e4e0cf2f req-ebd91352-4fa7-42cf-b5ee-d71883ef25f9 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.376081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-82999f7c-78b5-43cb-8034-19e8e4e0cf2f req-ebd91352-4fa7-42cf-b5ee-d71883ef25f9 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.398447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-82999f7c-78b5-43cb-8034-19e8e4e0cf2f req-ebd91352-4fa7-42cf-b5ee-d71883ef25f9 service nova] Creating event network-changed:159cee84-406e-4fca-9ca2-17925ac974a1 for instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec on hv-cinder-81514 May 26 12:50:34.407296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-82999f7c-78b5-43cb-8034-19e8e4e0cf2f req-ebd91352-4fa7-42cf-b5ee-d71883ef25f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057955 May 26 12:50:34.412271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 185/352] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:44.023002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f627a989-8483-4014-87b9-59cbc3cc2a27 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Action: 'create', calling method: .version_select at 0x7f498c465940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1021647175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW81zRro5V1/FmLed4miJE4ktouXC39TKwS9IFdA8h8GOtqHWPhxaaXn//sJOiUxt83zcMMhL9CTr4dFBTjflxM8VklRX85ujbUBoPjN9LtGIwqlla80XQbaH3psc8nbA=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:44.028118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=41 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:44.028773 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=32 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:44.040581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f627a989-8483-4014-87b9-59cbc3cc2a27 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Getting quotas for project b7059688f7a24761b61e51820c78a2ab. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:50:44.044878 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f627a989-8483-4014-87b9-59cbc3cc2a27 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Getting quotas for user db52c21a4c58422fa7ccad6232fc8f21 and project b7059688f7a24761b61e51820c78a2ab. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:50:44.182133 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f627a989-8483-4014-87b9-59cbc3cc2a27 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.162853 May 26 12:50:44.182752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 168/353] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 12:50:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:44.315401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-534085479", "imageRef": "77c1875d-685f-435f-9fb4-05aee6daea97", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1021647175", "networks": [{"uuid": "f0f84ae1-ea22-48b1-a17c-7c4962a8139f"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:44.370498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] validate_networks() for [('f0f84ae1-ea22-48b1-a17c-7c4962a8139f', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:50:44.391039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=41 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:44.762679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:50:44.763113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:50:44.763656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:50:44.764066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:50:44.764478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:50:44.773436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.774075 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.775310 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.775460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.793077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Getting quotas for project b7059688f7a24761b61e51820c78a2ab. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:50:44.797636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Getting quotas for user db52c21a4c58422fa7ccad6232fc8f21 and project b7059688f7a24761b61e51820c78a2ab. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:50:44.808303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:50:44.811305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77c1875d-685f-435f-9fb4-05aee6daea97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:50:44.902853 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aeb20721-c993-42c1-a507-498b7455ca0b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592729 May 26 12:50:44.906950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 186/354] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:50:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:50:44.915878 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1432335c-7c7e-42cc-8393-3b5929913770 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:44.916486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1432335c-7c7e-42cc-8393-3b5929913770 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:45.001542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1432335c-7c7e-42cc-8393-3b5929913770 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:45.009668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1432335c-7c7e-42cc-8393-3b5929913770 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1258 microversion: 2.1 time: 0.097853 May 26 12:50:45.010232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 169/355] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:44 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1258 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:46.028299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-745d1278-75aa-45b9-aa46-f21f690dbc8e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:46.028907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-745d1278-75aa-45b9-aa46-f21f690dbc8e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:46.091126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-745d1278-75aa-45b9-aa46-f21f690dbc8e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:46.099593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-745d1278-75aa-45b9-aa46-f21f690dbc8e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1258 microversion: 2.1 time: 0.075557 May 26 12:50:46.100482 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 187/356] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:46 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:47.117215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fbd24ddd-c292-411f-bb24-e11e6deb8a93 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:47.117780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fbd24ddd-c292-411f-bb24-e11e6deb8a93 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:47.125303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbd24ddd-c292-411f-bb24-e11e6deb8a93 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:47.128285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbd24ddd-c292-411f-bb24-e11e6deb8a93 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:47.128285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbd24ddd-c292-411f-bb24-e11e6deb8a93 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:47.128285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbd24ddd-c292-411f-bb24-e11e6deb8a93 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:47.189937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fbd24ddd-c292-411f-bb24-e11e6deb8a93 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:47.197662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fbd24ddd-c292-411f-bb24-e11e6deb8a93 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1262 microversion: 2.1 time: 0.084951 May 26 12:50:47.198257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 170/357] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:47 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:48.215329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-226202bb-2d88-4e78-a8c9-eae3143096d8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:48.217942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-226202bb-2d88-4e78-a8c9-eae3143096d8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:48.227242 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-226202bb-2d88-4e78-a8c9-eae3143096d8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.227242 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-226202bb-2d88-4e78-a8c9-eae3143096d8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.227624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-226202bb-2d88-4e78-a8c9-eae3143096d8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.228171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-226202bb-2d88-4e78-a8c9-eae3143096d8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.303147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-226202bb-2d88-4e78-a8c9-eae3143096d8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:48.310990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-226202bb-2d88-4e78-a8c9-eae3143096d8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1310 microversion: 2.1 time: 0.099749 May 26 12:50:48.311567 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 188/358] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:48 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:49.333481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdac74bf-587c-4a11-bba6-077c9377b5b1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:49.334390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cdac74bf-587c-4a11-bba6-077c9377b5b1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:49.342036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdac74bf-587c-4a11-bba6-077c9377b5b1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:49.342738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdac74bf-587c-4a11-bba6-077c9377b5b1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:49.343704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdac74bf-587c-4a11-bba6-077c9377b5b1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:49.344378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdac74bf-587c-4a11-bba6-077c9377b5b1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:49.604357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cdac74bf-587c-4a11-bba6-077c9377b5b1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:49.621649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdac74bf-587c-4a11-bba6-077c9377b5b1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.292155 May 26 12:50:49.632448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 171/359] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:49 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:50.640132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-055d73e2-bd3b-46ad-ab37-7675f683fc7b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:50.640762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-055d73e2-bd3b-46ad-ab37-7675f683fc7b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:50.642861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:50.652375 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-055d73e2-bd3b-46ad-ab37-7675f683fc7b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:50.658851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-055d73e2-bd3b-46ad-ab37-7675f683fc7b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:50.660894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-055d73e2-bd3b-46ad-ab37-7675f683fc7b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:50.661627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-055d73e2-bd3b-46ad-ab37-7675f683fc7b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:50.942952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-a7d948e2-a8e1-4f78-8555-76b677c6008c req-5461c9c8-b09f-4a98-b2bb-f02b0a010527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e5b57b-24ad-473d-9c97-b337fbac6fdc", "tag": "fc34668d-8f02-4867-b0e0-992d7f4dad7d"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:50.943427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-055d73e2-bd3b-46ad-ab37-7675f683fc7b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:50.958416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-055d73e2-bd3b-46ad-ab37-7675f683fc7b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.319375 May 26 12:50:50.959892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 189/360] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:50 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:50.977873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a7d948e2-a8e1-4f78-8555-76b677c6008c req-5461c9c8-b09f-4a98-b2bb-f02b0a010527 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:50.978511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a7d948e2-a8e1-4f78-8555-76b677c6008c req-5461c9c8-b09f-4a98-b2bb-f02b0a010527 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:50.992685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-a7d948e2-a8e1-4f78-8555-76b677c6008c req-5461c9c8-b09f-4a98-b2bb-f02b0a010527 service nova] Creating event network-changed:fc34668d-8f02-4867-b0e0-992d7f4dad7d for instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc on hv-cinder-81514 May 26 12:50:51.000208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-a7d948e2-a8e1-4f78-8555-76b677c6008c req-5461c9c8-b09f-4a98-b2bb-f02b0a010527 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066366 May 26 12:50:51.007308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 172/361] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:50:51.977122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-daeb24a2-4808-4d4c-804f-26f679db3ad9 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:51.977723 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-daeb24a2-4808-4d4c-804f-26f679db3ad9 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:51.985225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-daeb24a2-4808-4d4c-804f-26f679db3ad9 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:51.985678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-daeb24a2-4808-4d4c-804f-26f679db3ad9 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:51.986448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-daeb24a2-4808-4d4c-804f-26f679db3ad9 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:51.986907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-daeb24a2-4808-4d4c-804f-26f679db3ad9 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:52.148762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-daeb24a2-4808-4d4c-804f-26f679db3ad9 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:52.157728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-daeb24a2-4808-4d4c-804f-26f679db3ad9 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.184349 May 26 12:50:52.158319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 190/362] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:51 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:53.180827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0c840804-bfbf-47bb-bf74-34da9b41b8aa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:53.180827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0c840804-bfbf-47bb-bf74-34da9b41b8aa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:53.186918 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c840804-bfbf-47bb-bf74-34da9b41b8aa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:53.187703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c840804-bfbf-47bb-bf74-34da9b41b8aa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:53.188726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c840804-bfbf-47bb-bf74-34da9b41b8aa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:53.189389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c840804-bfbf-47bb-bf74-34da9b41b8aa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:53.328268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0c840804-bfbf-47bb-bf74-34da9b41b8aa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:53.335729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0c840804-bfbf-47bb-bf74-34da9b41b8aa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.163900 May 26 12:50:53.336309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 173/363] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:53 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:54.352030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0e3cee5c-dd0d-40ae-956d-d641fc9ea434 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:54.352622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0e3cee5c-dd0d-40ae-956d-d641fc9ea434 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:54.359335 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e3cee5c-dd0d-40ae-956d-d641fc9ea434 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:54.359779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e3cee5c-dd0d-40ae-956d-d641fc9ea434 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:54.362811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e3cee5c-dd0d-40ae-956d-d641fc9ea434 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:54.363290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e3cee5c-dd0d-40ae-956d-d641fc9ea434 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:54.492914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0e3cee5c-dd0d-40ae-956d-d641fc9ea434 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:54.501268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0e3cee5c-dd0d-40ae-956d-d641fc9ea434 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.153197 May 26 12:50:54.501834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 191/364] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:54 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:55.518799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-10faa04e-af18-4f82-aa39-830cfe40441a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:55.519474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-10faa04e-af18-4f82-aa39-830cfe40441a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:55.521903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:55.527203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10faa04e-af18-4f82-aa39-830cfe40441a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:55.528358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10faa04e-af18-4f82-aa39-830cfe40441a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:55.529162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10faa04e-af18-4f82-aa39-830cfe40441a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:55.529598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10faa04e-af18-4f82-aa39-830cfe40441a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:55.660078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-10faa04e-af18-4f82-aa39-830cfe40441a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:55.667463 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-10faa04e-af18-4f82-aa39-830cfe40441a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.152579 May 26 12:50:55.668126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 174/365] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:55 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:56.685274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fcdc2ab-c468-4c0e-86ac-119f49821b68 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:56.685887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fcdc2ab-c468-4c0e-86ac-119f49821b68 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:56.687843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:56.688524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=8 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:56.694192 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fcdc2ab-c468-4c0e-86ac-119f49821b68 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:56.694680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fcdc2ab-c468-4c0e-86ac-119f49821b68 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:56.695458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fcdc2ab-c468-4c0e-86ac-119f49821b68 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:56.695894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fcdc2ab-c468-4c0e-86ac-119f49821b68 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:56.835527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fcdc2ab-c468-4c0e-86ac-119f49821b68 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:56.845449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fcdc2ab-c468-4c0e-86ac-119f49821b68 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.164056 May 26 12:50:56.846100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 192/366] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:56 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:57.867038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f28f60d0-a489-444b-869c-4918722c027b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:57.867647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f28f60d0-a489-444b-869c-4918722c027b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:57.875239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f28f60d0-a489-444b-869c-4918722c027b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:57.875693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f28f60d0-a489-444b-869c-4918722c027b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:57.876466 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f28f60d0-a489-444b-869c-4918722c027b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:57.876922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f28f60d0-a489-444b-869c-4918722c027b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:58.013223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f28f60d0-a489-444b-869c-4918722c027b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:58.020738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f28f60d0-a489-444b-869c-4918722c027b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.157589 May 26 12:50:58.021316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 175/367] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:57 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:59.038284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52671f20-d827-4ccf-a1eb-a0b110903072 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:59.039153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52671f20-d827-4ccf-a1eb-a0b110903072 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:59.045680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52671f20-d827-4ccf-a1eb-a0b110903072 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:59.046396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52671f20-d827-4ccf-a1eb-a0b110903072 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:59.047325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52671f20-d827-4ccf-a1eb-a0b110903072 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:59.047858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52671f20-d827-4ccf-a1eb-a0b110903072 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:59.179975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52671f20-d827-4ccf-a1eb-a0b110903072 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:59.188297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52671f20-d827-4ccf-a1eb-a0b110903072 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.153983 May 26 12:50:59.188869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 193/368] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:50:59 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:59.396856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1977831368", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "networks": [{"uuid": "cd04a690-5cf5-4c3b-ba42-b7e5946b37c4"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:59.460973 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] validate_networks() for [('cd04a690-5cf5-4c3b-ba42-b7e5946b37c4', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:51:00.116283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:51:00.116715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:51:00.117309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:51:00.117730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:51:00.118148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:51:00.127211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:00.127687 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:00.128597 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:00.129038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:00.147258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Getting quotas for project b2c3cf0851794497aac57c9d2fbfc6da. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:00.151643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Getting quotas for user b1933169d9a94afb9393d35f3a523c25 and project b2c3cf0851794497aac57c9d2fbfc6da. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:00.163556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:51:00.165817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:51:00.205413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b60c02c6-760c-4feb-8fbb-957328bb7410 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:00.206100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b60c02c6-760c-4feb-8fbb-957328bb7410 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:00.212075 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b60c02c6-760c-4feb-8fbb-957328bb7410 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:00.214575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b60c02c6-760c-4feb-8fbb-957328bb7410 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:00.214575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b60c02c6-760c-4feb-8fbb-957328bb7410 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:00.214575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b60c02c6-760c-4feb-8fbb-957328bb7410 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:00.350175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b60c02c6-760c-4feb-8fbb-957328bb7410 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:00.357517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a5294e75-6e12-4dc8-8fee-ef982caff537 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964452 May 26 12:51:00.358512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 176/369] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:51:00.363012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b60c02c6-760c-4feb-8fbb-957328bb7410 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.157073 May 26 12:51:00.363012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 194/370] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:00 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:00.368286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4a1781fe-0406-4988-af37-32c7f04932c9 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:00.368896 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4a1781fe-0406-4988-af37-32c7f04932c9 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:00.421035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4a1781fe-0406-4988-af37-32c7f04932c9 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:00.429694 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4a1781fe-0406-4988-af37-32c7f04932c9 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1214 microversion: 2.1 time: 0.065100 May 26 12:51:00.430251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 177/371] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:00 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:01.376238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3eb8d794-9c25-4acb-bfd8-8334380ad0e5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:01.376849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3eb8d794-9c25-4acb-bfd8-8334380ad0e5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:01.382969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb8d794-9c25-4acb-bfd8-8334380ad0e5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:01.383359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb8d794-9c25-4acb-bfd8-8334380ad0e5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:01.384112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb8d794-9c25-4acb-bfd8-8334380ad0e5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:01.384548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb8d794-9c25-4acb-bfd8-8334380ad0e5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:01.446447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7775f09a-d290-4df9-81a8-0106235d7e29 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:01.447108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7775f09a-d290-4df9-81a8-0106235d7e29 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:01.499866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7775f09a-d290-4df9-81a8-0106235d7e29 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:01.506485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7775f09a-d290-4df9-81a8-0106235d7e29 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1214 microversion: 2.1 time: 0.064059 May 26 12:51:01.507126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 178/372] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:01 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:01.514024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3eb8d794-9c25-4acb-bfd8-8334380ad0e5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:01.521559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3eb8d794-9c25-4acb-bfd8-8334380ad0e5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.150189 May 26 12:51:01.522116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 195/373] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:01 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:02.523909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2bd5e850-ada6-48ac-b623-c2233cc7aab2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:02.524481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2bd5e850-ada6-48ac-b623-c2233cc7aab2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:02.532892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bd5e850-ada6-48ac-b623-c2233cc7aab2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:02.533435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bd5e850-ada6-48ac-b623-c2233cc7aab2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:02.534214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bd5e850-ada6-48ac-b623-c2233cc7aab2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:02.534689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bd5e850-ada6-48ac-b623-c2233cc7aab2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:02.541442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-08ff8bab-a6f8-4c9e-9874-ec4b6f43c898 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:02.542035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-08ff8bab-a6f8-4c9e-9874-ec4b6f43c898 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:02.549209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08ff8bab-a6f8-4c9e-9874-ec4b6f43c898 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:02.549726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08ff8bab-a6f8-4c9e-9874-ec4b6f43c898 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:02.550624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08ff8bab-a6f8-4c9e-9874-ec4b6f43c898 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:02.551255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08ff8bab-a6f8-4c9e-9874-ec4b6f43c898 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:02.604041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2bd5e850-ada6-48ac-b623-c2233cc7aab2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:02.614513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2bd5e850-ada6-48ac-b623-c2233cc7aab2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1218 microversion: 2.1 time: 0.094580 May 26 12:51:02.617076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 179/374] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:02 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:02.712664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-08ff8bab-a6f8-4c9e-9874-ec4b6f43c898 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:02.719240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-08ff8bab-a6f8-4c9e-9874-ec4b6f43c898 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.181856 May 26 12:51:02.719809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 196/375] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:02 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:03.633016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7ba5df6-8c81-4dc0-83f8-32b1b8231878 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:03.633618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7ba5df6-8c81-4dc0-83f8-32b1b8231878 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:03.640510 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7ba5df6-8c81-4dc0-83f8-32b1b8231878 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:03.640966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7ba5df6-8c81-4dc0-83f8-32b1b8231878 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:03.641735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7ba5df6-8c81-4dc0-83f8-32b1b8231878 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:03.642188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7ba5df6-8c81-4dc0-83f8-32b1b8231878 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:03.703249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7ba5df6-8c81-4dc0-83f8-32b1b8231878 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:03.710613 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7ba5df6-8c81-4dc0-83f8-32b1b8231878 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1218 microversion: 2.1 time: 0.081541 May 26 12:51:03.711192 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 180/376] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:03 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:03.736964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23bf5759-1281-4f78-95ef-51391c97700d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:03.737599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23bf5759-1281-4f78-95ef-51391c97700d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:03.743613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23bf5759-1281-4f78-95ef-51391c97700d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:03.744066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23bf5759-1281-4f78-95ef-51391c97700d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:03.744832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23bf5759-1281-4f78-95ef-51391c97700d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:03.745275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23bf5759-1281-4f78-95ef-51391c97700d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:03.883523 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-23bf5759-1281-4f78-95ef-51391c97700d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:03.891555 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23bf5759-1281-4f78-95ef-51391c97700d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.158487 May 26 12:51:03.892317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 197/377] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:03 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:04.447431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8508012-d279-4ce6-b92b-907f59717735 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:04.448004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8508012-d279-4ce6-b92b-907f59717735 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:04.454649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8508012-d279-4ce6-b92b-907f59717735 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:04.455100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8508012-d279-4ce6-b92b-907f59717735 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:04.455861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8508012-d279-4ce6-b92b-907f59717735 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:04.456292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8508012-d279-4ce6-b92b-907f59717735 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:04.480159 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8508012-d279-4ce6-b92b-907f59717735 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/ips" status: 200 len: 151 microversion: 2.1 time: 0.036412 May 26 12:51:04.480807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 181/378] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 12:51:04 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:04.728076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85687843-5761-4bd3-93fd-2e6bfb514be4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:04.728682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85687843-5761-4bd3-93fd-2e6bfb514be4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:04.735777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85687843-5761-4bd3-93fd-2e6bfb514be4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:04.736223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85687843-5761-4bd3-93fd-2e6bfb514be4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:04.737032 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85687843-5761-4bd3-93fd-2e6bfb514be4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:04.737606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85687843-5761-4bd3-93fd-2e6bfb514be4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:04.798091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85687843-5761-4bd3-93fd-2e6bfb514be4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:04.805515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85687843-5761-4bd3-93fd-2e6bfb514be4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1218 microversion: 2.1 time: 0.081380 May 26 12:51:04.806042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 198/379] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:04 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:04.908040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf3d4f36-c7b8-4fbf-8fb9-aa5dd20bb0b6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:04.908755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf3d4f36-c7b8-4fbf-8fb9-aa5dd20bb0b6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:04.915460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf3d4f36-c7b8-4fbf-8fb9-aa5dd20bb0b6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:04.917538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf3d4f36-c7b8-4fbf-8fb9-aa5dd20bb0b6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:04.917538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf3d4f36-c7b8-4fbf-8fb9-aa5dd20bb0b6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:04.917538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf3d4f36-c7b8-4fbf-8fb9-aa5dd20bb0b6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:05.046260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf3d4f36-c7b8-4fbf-8fb9-aa5dd20bb0b6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:05.053760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf3d4f36-c7b8-4fbf-8fb9-aa5dd20bb0b6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.149554 May 26 12:51:05.054360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 182/380] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:04 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:05.822227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-256e70c8-cf0c-4dcf-9e6c-c6ff8bb4a3c7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:05.822798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-256e70c8-cf0c-4dcf-9e6c-c6ff8bb4a3c7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:05.829026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256e70c8-cf0c-4dcf-9e6c-c6ff8bb4a3c7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:05.829477 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256e70c8-cf0c-4dcf-9e6c-c6ff8bb4a3c7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:05.830243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256e70c8-cf0c-4dcf-9e6c-c6ff8bb4a3c7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:05.830799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256e70c8-cf0c-4dcf-9e6c-c6ff8bb4a3c7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:05.892252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-256e70c8-cf0c-4dcf-9e6c-c6ff8bb4a3c7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:05.904712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-256e70c8-cf0c-4dcf-9e6c-c6ff8bb4a3c7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1218 microversion: 2.1 time: 0.086439 May 26 12:51:05.913234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 199/381] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:05 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:06.070200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7240b1b2-a5c5-457d-89b3-29152542b59b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:06.071313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7240b1b2-a5c5-457d-89b3-29152542b59b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:06.077791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7240b1b2-a5c5-457d-89b3-29152542b59b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:06.078176 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7240b1b2-a5c5-457d-89b3-29152542b59b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:06.079049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7240b1b2-a5c5-457d-89b3-29152542b59b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:06.079627 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7240b1b2-a5c5-457d-89b3-29152542b59b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:06.252772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7240b1b2-a5c5-457d-89b3-29152542b59b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:06.260521 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7240b1b2-a5c5-457d-89b3-29152542b59b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.194139 May 26 12:51:06.261077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 183/382] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:06 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:06.921690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0716bf47-7c1e-4a78-bac4-787ffe5b3974 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:06.922309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0716bf47-7c1e-4a78-bac4-787ffe5b3974 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:06.928949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0716bf47-7c1e-4a78-bac4-787ffe5b3974 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:06.929404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0716bf47-7c1e-4a78-bac4-787ffe5b3974 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:06.930199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0716bf47-7c1e-4a78-bac4-787ffe5b3974 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:06.930697 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0716bf47-7c1e-4a78-bac4-787ffe5b3974 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:07.001800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0716bf47-7c1e-4a78-bac4-787ffe5b3974 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:07.009262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0716bf47-7c1e-4a78-bac4-787ffe5b3974 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1266 microversion: 2.1 time: 0.092018 May 26 12:51:07.011517 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 200/383] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:06 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:07.278663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a2e4ab26-28c1-42b9-acbf-f802cd62b938 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:07.279506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a2e4ab26-28c1-42b9-acbf-f802cd62b938 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:07.288271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2e4ab26-28c1-42b9-acbf-f802cd62b938 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:07.288724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2e4ab26-28c1-42b9-acbf-f802cd62b938 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:07.289532 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2e4ab26-28c1-42b9-acbf-f802cd62b938 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:07.289967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2e4ab26-28c1-42b9-acbf-f802cd62b938 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:07.423578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a2e4ab26-28c1-42b9-acbf-f802cd62b938 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:07.430992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a2e4ab26-28c1-42b9-acbf-f802cd62b938 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.157232 May 26 12:51:07.431555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 184/384] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:07 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:08.026570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56704764-ae60-40f5-9cad-6b8ecb64abb2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:08.027244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56704764-ae60-40f5-9cad-6b8ecb64abb2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:08.033398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56704764-ae60-40f5-9cad-6b8ecb64abb2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:08.033859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56704764-ae60-40f5-9cad-6b8ecb64abb2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:08.034682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56704764-ae60-40f5-9cad-6b8ecb64abb2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:08.035126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56704764-ae60-40f5-9cad-6b8ecb64abb2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:08.099687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56704764-ae60-40f5-9cad-6b8ecb64abb2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:08.107632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56704764-ae60-40f5-9cad-6b8ecb64abb2 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1274 microversion: 2.1 time: 0.085124 May 26 12:51:08.108187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 201/385] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:08 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:08.325653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-66a9f9c5-75be-4143-bc22-e2f9914d01bc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0230b752-3b39-411b-82ba-d281ffa1e575"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:08.326793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-66a9f9c5-75be-4143-bc22-e2f9914d01bc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:08.333297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66a9f9c5-75be-4143-bc22-e2f9914d01bc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:08.333748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66a9f9c5-75be-4143-bc22-e2f9914d01bc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:08.334548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66a9f9c5-75be-4143-bc22-e2f9914d01bc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:08.334979 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66a9f9c5-75be-4143-bc22-e2f9914d01bc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:08.447801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7521fcaf-b311-471f-8f67-979617318cf1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:08.448481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7521fcaf-b311-471f-8f67-979617318cf1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:08.454512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7521fcaf-b311-471f-8f67-979617318cf1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:08.454976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7521fcaf-b311-471f-8f67-979617318cf1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:08.455734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7521fcaf-b311-471f-8f67-979617318cf1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:08.456172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7521fcaf-b311-471f-8f67-979617318cf1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:08.586815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7521fcaf-b311-471f-8f67-979617318cf1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:08.594919 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7521fcaf-b311-471f-8f67-979617318cf1 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.150839 May 26 12:51:08.595500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 202/386] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:08 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:08.629155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1124198086", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1173115337", "security_groups": [{"name": "tempest-secgroup-smoke-1803318874"}], "networks": [{"uuid": "dd88beae-cb32-46f0-9a0f-349f8b779cd8"}], "block_device_mapping_v2": [{"uuid": "cbbce951-a374-45e4-8b59-6bb1ef0d043b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:08.740069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] validate_networks() for [('dd88beae-cb32-46f0-9a0f-349f8b779cd8', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:51:09.099192 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:51:09.099758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:51:09.100092 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:51:09.100504 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:51:09.100922 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:51:09.110499 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:09.110978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:09.111783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:09.112222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:09.129507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Getting quotas for project d6cc833734e44b588c6d0d52c3ca7b84. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:09.133335 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Getting quotas for user 160c6175803b45bf80591084ad4e92ba and project d6cc833734e44b588c6d0d52c3ca7b84. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:09.191086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:51:09.192350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbbce951-a374-45e4-8b59-6bb1ef0d043b',volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:51:09.817093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-143c3b3a-964b-47db-bc99-cf9759eaa62f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.191647 May 26 12:51:09.817738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 203/387] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:51:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:51:09.822156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13ef3a11-e9cc-48b1-9c50-c5ee9ba31509 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:09.822795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-13ef3a11-e9cc-48b1-9c50-c5ee9ba31509 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:09.829367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ef3a11-e9cc-48b1-9c50-c5ee9ba31509 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:09.829818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ef3a11-e9cc-48b1-9c50-c5ee9ba31509 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:09.830644 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ef3a11-e9cc-48b1-9c50-c5ee9ba31509 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:09.831089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ef3a11-e9cc-48b1-9c50-c5ee9ba31509 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:09.893164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-13ef3a11-e9cc-48b1-9c50-c5ee9ba31509 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:09.896593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:09.901082 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-13ef3a11-e9cc-48b1-9c50-c5ee9ba31509 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1274 microversion: 2.1 time: 0.082403 May 26 12:51:09.902196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 204/388] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:09 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:09.906792 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23a18679-656f-42c0-aa71-2997d5a547b2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:09.907619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23a18679-656f-42c0-aa71-2997d5a547b2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:09.914296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23a18679-656f-42c0-aa71-2997d5a547b2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:09.918313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23a18679-656f-42c0-aa71-2997d5a547b2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:09.918313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23a18679-656f-42c0-aa71-2997d5a547b2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:09.918313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23a18679-656f-42c0-aa71-2997d5a547b2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:10.048304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-23a18679-656f-42c0-aa71-2997d5a547b2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:10.055658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23a18679-656f-42c0-aa71-2997d5a547b2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.152429 May 26 12:51:10.056217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 205/389] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:09 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:10.060893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-69675d49-85a8-4269-a89b-6dee04ee63cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:10.061494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-69675d49-85a8-4269-a89b-6dee04ee63cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:10.118636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69675d49-85a8-4269-a89b-6dee04ee63cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:10.125556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-69675d49-85a8-4269-a89b-6dee04ee63cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1089 microversion: 2.1 time: 0.068386 May 26 12:51:10.126115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 206/390] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:10 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:10.136423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:10.918675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc9fe308-7d7b-46d3-b8ff-92b53d9d30f0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:10.919351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc9fe308-7d7b-46d3-b8ff-92b53d9d30f0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:10.925368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc9fe308-7d7b-46d3-b8ff-92b53d9d30f0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:10.925815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc9fe308-7d7b-46d3-b8ff-92b53d9d30f0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:10.926620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc9fe308-7d7b-46d3-b8ff-92b53d9d30f0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:10.927055 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc9fe308-7d7b-46d3-b8ff-92b53d9d30f0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:10.988095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc9fe308-7d7b-46d3-b8ff-92b53d9d30f0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:10.996036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc9fe308-7d7b-46d3-b8ff-92b53d9d30f0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1274 microversion: 2.1 time: 0.081496 May 26 12:51:10.996602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 207/391] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:10 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:11.071996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17044b96-03ef-4647-9d11-b73aa8a97a2f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:11.072534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17044b96-03ef-4647-9d11-b73aa8a97a2f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:11.079587 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17044b96-03ef-4647-9d11-b73aa8a97a2f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:11.084756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17044b96-03ef-4647-9d11-b73aa8a97a2f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:11.084756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17044b96-03ef-4647-9d11-b73aa8a97a2f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:11.084756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17044b96-03ef-4647-9d11-b73aa8a97a2f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:11.211703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-17044b96-03ef-4647-9d11-b73aa8a97a2f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:11.221435 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17044b96-03ef-4647-9d11-b73aa8a97a2f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.153272 May 26 12:51:11.222057 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 208/392] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:11 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:11.226655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef6cc364-f9e2-4f0a-98b4-9abf4c72fa29 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:11.227300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef6cc364-f9e2-4f0a-98b4-9abf4c72fa29 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:11.233961 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef6cc364-f9e2-4f0a-98b4-9abf4c72fa29 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:11.234409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef6cc364-f9e2-4f0a-98b4-9abf4c72fa29 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:11.235200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef6cc364-f9e2-4f0a-98b4-9abf4c72fa29 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:11.235631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef6cc364-f9e2-4f0a-98b4-9abf4c72fa29 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:11.296938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef6cc364-f9e2-4f0a-98b4-9abf4c72fa29 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:11.304448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef6cc364-f9e2-4f0a-98b4-9abf4c72fa29 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1139 microversion: 2.1 time: 0.081430 May 26 12:51:11.305042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 209/393] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:11 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:11.504381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=10 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:12.012977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c6ff221-83fd-4438-b330-682f0c88207d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:12.013609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c6ff221-83fd-4438-b330-682f0c88207d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:12.019704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c6ff221-83fd-4438-b330-682f0c88207d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:12.020154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c6ff221-83fd-4438-b330-682f0c88207d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:12.020916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c6ff221-83fd-4438-b330-682f0c88207d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:12.021352 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c6ff221-83fd-4438-b330-682f0c88207d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:12.088271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c6ff221-83fd-4438-b330-682f0c88207d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:12.097601 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c6ff221-83fd-4438-b330-682f0c88207d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1274 microversion: 2.1 time: 0.088539 May 26 12:51:12.098103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 210/394] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:12 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:12.238702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-22e41e9b-2e8d-4b89-b2fb-b612d9506c26 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:12.239344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-22e41e9b-2e8d-4b89-b2fb-b612d9506c26 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:12.247036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22e41e9b-2e8d-4b89-b2fb-b612d9506c26 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:12.247495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22e41e9b-2e8d-4b89-b2fb-b612d9506c26 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:12.248325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22e41e9b-2e8d-4b89-b2fb-b612d9506c26 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:12.248759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22e41e9b-2e8d-4b89-b2fb-b612d9506c26 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:12.400816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-22e41e9b-2e8d-4b89-b2fb-b612d9506c26 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:12.409659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-22e41e9b-2e8d-4b89-b2fb-b612d9506c26 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.174781 May 26 12:51:12.410226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 211/395] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:12 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:12.414732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a312cf60-b24f-4039-924e-732ef85d69c7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:12.415338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a312cf60-b24f-4039-924e-732ef85d69c7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:12.422831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a312cf60-b24f-4039-924e-732ef85d69c7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:12.423282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a312cf60-b24f-4039-924e-732ef85d69c7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:12.424058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a312cf60-b24f-4039-924e-732ef85d69c7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:12.424495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a312cf60-b24f-4039-924e-732ef85d69c7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:12.487539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a312cf60-b24f-4039-924e-732ef85d69c7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:12.495062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a312cf60-b24f-4039-924e-732ef85d69c7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1139 microversion: 2.1 time: 0.083784 May 26 12:51:12.495689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 212/396] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:12 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:13.116272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-51733f39-4d18-418b-880d-b8f91dc959f1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:13.116806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-51733f39-4d18-418b-880d-b8f91dc959f1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:13.123505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51733f39-4d18-418b-880d-b8f91dc959f1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:13.123958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51733f39-4d18-418b-880d-b8f91dc959f1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:13.124718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51733f39-4d18-418b-880d-b8f91dc959f1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:13.125156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51733f39-4d18-418b-880d-b8f91dc959f1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:13.185734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51733f39-4d18-418b-880d-b8f91dc959f1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:13.193170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-51733f39-4d18-418b-880d-b8f91dc959f1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1274 microversion: 2.1 time: 0.080820 May 26 12:51:13.193934 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 213/397] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:13 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:13.427622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c5cfe74d-08fb-452c-86ec-faccf0543138 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:13.448463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c5cfe74d-08fb-452c-86ec-faccf0543138 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:13.448463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5cfe74d-08fb-452c-86ec-faccf0543138 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:13.448463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5cfe74d-08fb-452c-86ec-faccf0543138 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:13.448463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5cfe74d-08fb-452c-86ec-faccf0543138 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:13.449054 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5cfe74d-08fb-452c-86ec-faccf0543138 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:13.590290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c5cfe74d-08fb-452c-86ec-faccf0543138 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:13.598516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c5cfe74d-08fb-452c-86ec-faccf0543138 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.175369 May 26 12:51:13.599098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 214/398] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:13 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:13.608045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61c6fa8b-0ff3-4994-a4e2-b02dbd48ec4d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:13.608646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61c6fa8b-0ff3-4994-a4e2-b02dbd48ec4d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:13.614573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61c6fa8b-0ff3-4994-a4e2-b02dbd48ec4d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:13.615020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61c6fa8b-0ff3-4994-a4e2-b02dbd48ec4d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:13.615779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61c6fa8b-0ff3-4994-a4e2-b02dbd48ec4d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:13.616214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61c6fa8b-0ff3-4994-a4e2-b02dbd48ec4d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:13.679882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-61c6fa8b-0ff3-4994-a4e2-b02dbd48ec4d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:13.688235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-61c6fa8b-0ff3-4994-a4e2-b02dbd48ec4d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1139 microversion: 2.1 time: 0.088182 May 26 12:51:13.688909 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 215/399] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:13 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:14.211300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e3baf6e7-14a1-4f68-90e4-72d57e7f4357 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:14.211902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e3baf6e7-14a1-4f68-90e4-72d57e7f4357 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:14.218644 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3baf6e7-14a1-4f68-90e4-72d57e7f4357 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:14.219091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3baf6e7-14a1-4f68-90e4-72d57e7f4357 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:14.219842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3baf6e7-14a1-4f68-90e4-72d57e7f4357 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:14.220274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3baf6e7-14a1-4f68-90e4-72d57e7f4357 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:14.281897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3baf6e7-14a1-4f68-90e4-72d57e7f4357 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:14.289611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e3baf6e7-14a1-4f68-90e4-72d57e7f4357 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1274 microversion: 2.1 time: 0.082179 May 26 12:51:14.290165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 216/400] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:14 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:14.616425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-73cef50d-05a0-4a4d-9aca-4a0b9a4ba079 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:14.617097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-73cef50d-05a0-4a4d-9aca-4a0b9a4ba079 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:14.623502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73cef50d-05a0-4a4d-9aca-4a0b9a4ba079 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:14.623946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73cef50d-05a0-4a4d-9aca-4a0b9a4ba079 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:14.624700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73cef50d-05a0-4a4d-9aca-4a0b9a4ba079 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:14.625130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73cef50d-05a0-4a4d-9aca-4a0b9a4ba079 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:14.759149 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-73cef50d-05a0-4a4d-9aca-4a0b9a4ba079 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:14.767246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-73cef50d-05a0-4a4d-9aca-4a0b9a4ba079 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.154665 May 26 12:51:14.768358 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 217/401] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:14 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:14.773877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-962cdbe5-e7e3-49ec-b1e8-0b1c10ca2fe1 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:14.773877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-962cdbe5-e7e3-49ec-b1e8-0b1c10ca2fe1 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:14.780711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962cdbe5-e7e3-49ec-b1e8-0b1c10ca2fe1 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:14.781165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962cdbe5-e7e3-49ec-b1e8-0b1c10ca2fe1 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:14.781932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962cdbe5-e7e3-49ec-b1e8-0b1c10ca2fe1 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:14.782369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962cdbe5-e7e3-49ec-b1e8-0b1c10ca2fe1 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:14.845774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-962cdbe5-e7e3-49ec-b1e8-0b1c10ca2fe1 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:14.853458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-962cdbe5-e7e3-49ec-b1e8-0b1c10ca2fe1 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1139 microversion: 2.1 time: 0.084018 May 26 12:51:14.856226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 218/402] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:14 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:14.991944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=75 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:15.307404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c6c24669-5de5-4f3f-aab9-08d207ee9be8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:15.308576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c6c24669-5de5-4f3f-aab9-08d207ee9be8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:15.319584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6c24669-5de5-4f3f-aab9-08d207ee9be8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:15.319584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6c24669-5de5-4f3f-aab9-08d207ee9be8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:15.319584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6c24669-5de5-4f3f-aab9-08d207ee9be8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:15.319584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6c24669-5de5-4f3f-aab9-08d207ee9be8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:15.397673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c6c24669-5de5-4f3f-aab9-08d207ee9be8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:15.407625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c6c24669-5de5-4f3f-aab9-08d207ee9be8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1284 microversion: 2.1 time: 0.104819 May 26 12:51:15.408830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 219/403] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:15 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:15.757431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-66a9f9c5-75be-4143-bc22-e2f9914d01bc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.435510 May 26 12:51:15.760176 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 185/404] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:51:08 2022] POST /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments => generated 194 bytes in 7437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:15.784851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee23f49d-e0ce-4eee-9106-eb61ee535551 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:15.786110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee23f49d-e0ce-4eee-9106-eb61ee535551 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:15.795698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee23f49d-e0ce-4eee-9106-eb61ee535551 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:15.796419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee23f49d-e0ce-4eee-9106-eb61ee535551 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:15.797396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee23f49d-e0ce-4eee-9106-eb61ee535551 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:15.798005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee23f49d-e0ce-4eee-9106-eb61ee535551 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:15.872166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-240f6754-d83c-4523-83bc-bd6500e8e859 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:15.873152 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-240f6754-d83c-4523-83bc-bd6500e8e859 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:15.875390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:15.881244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-240f6754-d83c-4523-83bc-bd6500e8e859 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:15.881702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-240f6754-d83c-4523-83bc-bd6500e8e859 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:15.882489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-240f6754-d83c-4523-83bc-bd6500e8e859 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:15.883089 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-240f6754-d83c-4523-83bc-bd6500e8e859 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:15.951599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee23f49d-e0ce-4eee-9106-eb61ee535551 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:15.957640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-240f6754-d83c-4523-83bc-bd6500e8e859 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:15.959401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee23f49d-e0ce-4eee-9106-eb61ee535551 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.178366 May 26 12:51:15.959976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 220/405] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:15 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:15.966100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-240f6754-d83c-4523-83bc-bd6500e8e859 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1187 microversion: 2.1 time: 0.098542 May 26 12:51:15.966689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 186/406] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:15 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:16.426651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e1743ba-57db-4ed0-a45f-ea7c28d5167e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:16.428347 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e1743ba-57db-4ed0-a45f-ea7c28d5167e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:16.437023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1743ba-57db-4ed0-a45f-ea7c28d5167e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:16.437667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1743ba-57db-4ed0-a45f-ea7c28d5167e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:16.438459 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1743ba-57db-4ed0-a45f-ea7c28d5167e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:16.439096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1743ba-57db-4ed0-a45f-ea7c28d5167e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:16.585759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e1743ba-57db-4ed0-a45f-ea7c28d5167e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:16.593475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e1743ba-57db-4ed0-a45f-ea7c28d5167e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.172125 May 26 12:51:16.594037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 221/407] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:16 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:16.977765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-650d0514-4037-425f-a69d-8577975d56fd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:16.983945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4291eda3-2a05-4b2d-9ba3-671c30f886fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:16.984627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4291eda3-2a05-4b2d-9ba3-671c30f886fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:16.987254 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-650d0514-4037-425f-a69d-8577975d56fd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:16.994153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-650d0514-4037-425f-a69d-8577975d56fd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:16.998483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-650d0514-4037-425f-a69d-8577975d56fd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:16.998483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-650d0514-4037-425f-a69d-8577975d56fd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:16.998483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-650d0514-4037-425f-a69d-8577975d56fd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:17.004513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4291eda3-2a05-4b2d-9ba3-671c30f886fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:17.005085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4291eda3-2a05-4b2d-9ba3-671c30f886fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:17.006070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4291eda3-2a05-4b2d-9ba3-671c30f886fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:17.006800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4291eda3-2a05-4b2d-9ba3-671c30f886fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:17.026614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:17.074388 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4291eda3-2a05-4b2d-9ba3-671c30f886fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:17.082045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4291eda3-2a05-4b2d-9ba3-671c30f886fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1205 microversion: 2.1 time: 0.102589 May 26 12:51:17.082641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 222/408] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:16 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1205 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:17.209565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-650d0514-4037-425f-a69d-8577975d56fd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:17.217204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-650d0514-4037-425f-a69d-8577975d56fd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.243807 May 26 12:51:17.217771 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 187/409] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:16 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:17.309917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-70f14a5d-9759-4e4b-a90e-32e0c83a846d req-53ab2079-a55e-4622-9286-a67ea007432b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930f8e79-4127-485a-ba48-b2160b7f48d2", "tag": "8174c594-57a5-4fc2-a23c-4c496fc74df0"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:17.324640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-70f14a5d-9759-4e4b-a90e-32e0c83a846d req-53ab2079-a55e-4622-9286-a67ea007432b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:17.325076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-70f14a5d-9759-4e4b-a90e-32e0c83a846d req-53ab2079-a55e-4622-9286-a67ea007432b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:17.336316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-70f14a5d-9759-4e4b-a90e-32e0c83a846d req-53ab2079-a55e-4622-9286-a67ea007432b service nova] Creating event network-changed:8174c594-57a5-4fc2-a23c-4c496fc74df0 for instance 930f8e79-4127-485a-ba48-b2160b7f48d2 on hv-cinder-81514 May 26 12:51:17.341987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-70f14a5d-9759-4e4b-a90e-32e0c83a846d req-53ab2079-a55e-4622-9286-a67ea007432b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036695 May 26 12:51:17.342760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 223/410] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:17.614188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ac601a3-cc5c-4001-8ea8-8ce25473cd1b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:17.614840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ac601a3-cc5c-4001-8ea8-8ce25473cd1b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:17.621739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ac601a3-cc5c-4001-8ea8-8ce25473cd1b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:17.624920 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ac601a3-cc5c-4001-8ea8-8ce25473cd1b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:17.624920 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ac601a3-cc5c-4001-8ea8-8ce25473cd1b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:17.624920 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ac601a3-cc5c-4001-8ea8-8ce25473cd1b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:17.898316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ac601a3-cc5c-4001-8ea8-8ce25473cd1b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:17.906791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ac601a3-cc5c-4001-8ea8-8ce25473cd1b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.296376 May 26 12:51:17.907672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 188/411] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:17 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:18.103737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-484567f8-c1be-487a-bee7-64be7e26f670 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:18.105609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-484567f8-c1be-487a-bee7-64be7e26f670 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:18.109927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-b5042b1c-ad05-46ba-89fa-beb0c9925ece req-f13d0abb-b6aa-436d-aa97-f999b5621161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e5b57b-24ad-473d-9c97-b337fbac6fdc", "name": "network-vif-plugged", "status": "completed", "tag": "fc34668d-8f02-4867-b0e0-992d7f4dad7d"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:18.119032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484567f8-c1be-487a-bee7-64be7e26f670 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.119575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484567f8-c1be-487a-bee7-64be7e26f670 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:18.121274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b5042b1c-ad05-46ba-89fa-beb0c9925ece req-f13d0abb-b6aa-436d-aa97-f999b5621161 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.123180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b5042b1c-ad05-46ba-89fa-beb0c9925ece req-f13d0abb-b6aa-436d-aa97-f999b5621161 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:18.123410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484567f8-c1be-487a-bee7-64be7e26f670 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.123944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484567f8-c1be-487a-bee7-64be7e26f670 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:18.137324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-b5042b1c-ad05-46ba-89fa-beb0c9925ece req-f13d0abb-b6aa-436d-aa97-f999b5621161 service nova] Creating event network-vif-plugged:fc34668d-8f02-4867-b0e0-992d7f4dad7d for instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc on hv-cinder-81514 May 26 12:51:18.142642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-b5042b1c-ad05-46ba-89fa-beb0c9925ece req-f13d0abb-b6aa-436d-aa97-f999b5621161 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046785 May 26 12:51:18.143880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 224/412] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:18.234448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-037a06a9-c56c-457c-83cc-d08b449ccf0e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:18.235188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-037a06a9-c56c-457c-83cc-d08b449ccf0e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:18.246211 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-037a06a9-c56c-457c-83cc-d08b449ccf0e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.246925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-037a06a9-c56c-457c-83cc-d08b449ccf0e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:18.247875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-037a06a9-c56c-457c-83cc-d08b449ccf0e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.248470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-037a06a9-c56c-457c-83cc-d08b449ccf0e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:18.406348 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-037a06a9-c56c-457c-83cc-d08b449ccf0e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:18.414119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-037a06a9-c56c-457c-83cc-d08b449ccf0e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.184434 May 26 12:51:18.414720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 225/413] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:18 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:18.459623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-484567f8-c1be-487a-bee7-64be7e26f670 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:18.468799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-484567f8-c1be-487a-bee7-64be7e26f670 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.369084 May 26 12:51:18.469378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 189/414] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:18 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:18.923434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c54f7583-2a2d-4101-8be4-c839b4f9f5d7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:18.924044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c54f7583-2a2d-4101-8be4-c839b4f9f5d7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:18.930138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c54f7583-2a2d-4101-8be4-c839b4f9f5d7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.930641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c54f7583-2a2d-4101-8be4-c839b4f9f5d7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:18.931405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c54f7583-2a2d-4101-8be4-c839b4f9f5d7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:18.931875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c54f7583-2a2d-4101-8be4-c839b4f9f5d7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.093522 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c54f7583-2a2d-4101-8be4-c839b4f9f5d7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:19.101114 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c54f7583-2a2d-4101-8be4-c839b4f9f5d7 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.181303 May 26 12:51:19.111641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 226/415] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:18 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:19.364228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-54a28854-17a9-4e8d-85d3-4810699c056d req-300f3e4c-675b-49cd-9779-875c3643ee6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3a12be-8748-41ab-a6a4-17d666ea34d0", "tag": "e5d66805-9eb5-4134-a395-25cf61316cc2"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:19.377595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-54a28854-17a9-4e8d-85d3-4810699c056d req-300f3e4c-675b-49cd-9779-875c3643ee6b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:19.377595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-54a28854-17a9-4e8d-85d3-4810699c056d req-300f3e4c-675b-49cd-9779-875c3643ee6b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.389715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-54a28854-17a9-4e8d-85d3-4810699c056d req-300f3e4c-675b-49cd-9779-875c3643ee6b service nova] Creating event network-changed:e5d66805-9eb5-4134-a395-25cf61316cc2 for instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 on hv-cinder-81514 May 26 12:51:19.395519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-54a28854-17a9-4e8d-85d3-4810699c056d req-300f3e4c-675b-49cd-9779-875c3643ee6b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035855 May 26 12:51:19.396738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 190/416] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:19.432032 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a72fd9c-fb6e-4216-bac9-89fdd60fe7ff tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:19.432871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a72fd9c-fb6e-4216-bac9-89fdd60fe7ff tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:19.435132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:19.440140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a72fd9c-fb6e-4216-bac9-89fdd60fe7ff tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:19.440596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a72fd9c-fb6e-4216-bac9-89fdd60fe7ff tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.441368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a72fd9c-fb6e-4216-bac9-89fdd60fe7ff tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:19.441807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a72fd9c-fb6e-4216-bac9-89fdd60fe7ff tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.488017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e5b00d9-d1bb-4f06-96b3-fbbdaadee35d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:19.488887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e5b00d9-d1bb-4f06-96b3-fbbdaadee35d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:19.495798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e5b00d9-d1bb-4f06-96b3-fbbdaadee35d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:19.496252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e5b00d9-d1bb-4f06-96b3-fbbdaadee35d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.497039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e5b00d9-d1bb-4f06-96b3-fbbdaadee35d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:19.497489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e5b00d9-d1bb-4f06-96b3-fbbdaadee35d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:19.647500 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e5b00d9-d1bb-4f06-96b3-fbbdaadee35d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:19.656377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e5b00d9-d1bb-4f06-96b3-fbbdaadee35d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.174513 May 26 12:51:19.657000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 191/417] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:19 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:19.802851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a72fd9c-fb6e-4216-bac9-89fdd60fe7ff tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:19.811484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a72fd9c-fb6e-4216-bac9-89fdd60fe7ff tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.383577 May 26 12:51:19.812048 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 227/418] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:19 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:20.118062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2230090d-016a-4c31-8c38-5335238a9e0e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:20.118692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2230090d-016a-4c31-8c38-5335238a9e0e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:20.125360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2230090d-016a-4c31-8c38-5335238a9e0e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:20.125853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2230090d-016a-4c31-8c38-5335238a9e0e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:20.126661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2230090d-016a-4c31-8c38-5335238a9e0e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:20.127342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2230090d-016a-4c31-8c38-5335238a9e0e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:20.260654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2230090d-016a-4c31-8c38-5335238a9e0e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:20.268357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2230090d-016a-4c31-8c38-5335238a9e0e tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.153980 May 26 12:51:20.268853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 192/419] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:20 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:20.673985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e56fd679-1a49-4666-b3cf-53358cdabfd7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:20.674652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e56fd679-1a49-4666-b3cf-53358cdabfd7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:20.676524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=8 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:20.681356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e56fd679-1a49-4666-b3cf-53358cdabfd7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:20.681805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e56fd679-1a49-4666-b3cf-53358cdabfd7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:20.682582 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e56fd679-1a49-4666-b3cf-53358cdabfd7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:20.683018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e56fd679-1a49-4666-b3cf-53358cdabfd7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:20.825003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e56fd679-1a49-4666-b3cf-53358cdabfd7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:20.828352 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4f3e7df0-b42a-45dc-9d2f-0536aba3ca69 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:20.828961 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4f3e7df0-b42a-45dc-9d2f-0536aba3ca69 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:20.832657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e56fd679-1a49-4666-b3cf-53358cdabfd7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.162812 May 26 12:51:20.833253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 228/420] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:20 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:20.835522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f3e7df0-b42a-45dc-9d2f-0536aba3ca69 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:20.836044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f3e7df0-b42a-45dc-9d2f-0536aba3ca69 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:20.836815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f3e7df0-b42a-45dc-9d2f-0536aba3ca69 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:20.837252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f3e7df0-b42a-45dc-9d2f-0536aba3ca69 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:20.967501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4f3e7df0-b42a-45dc-9d2f-0536aba3ca69 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:20.975485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4f3e7df0-b42a-45dc-9d2f-0536aba3ca69 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.150912 May 26 12:51:20.976082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 193/421] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:20 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:21.285075 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-718a678c-9811-473c-a1d4-d966940e7df3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:21.285930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-718a678c-9811-473c-a1d4-d966940e7df3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:21.291953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-718a678c-9811-473c-a1d4-d966940e7df3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:21.292412 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-718a678c-9811-473c-a1d4-d966940e7df3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:21.294409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-718a678c-9811-473c-a1d4-d966940e7df3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:21.294881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-718a678c-9811-473c-a1d4-d966940e7df3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:21.428219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-718a678c-9811-473c-a1d4-d966940e7df3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:21.436202 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-718a678c-9811-473c-a1d4-d966940e7df3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.154969 May 26 12:51:21.436858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 229/422] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:21 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:21.849029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5ffc8332-bd10-49e1-999e-773a4faf026a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:21.849758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5ffc8332-bd10-49e1-999e-773a4faf026a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:21.856799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ffc8332-bd10-49e1-999e-773a4faf026a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:21.857253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ffc8332-bd10-49e1-999e-773a4faf026a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:21.858041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ffc8332-bd10-49e1-999e-773a4faf026a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:21.858484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ffc8332-bd10-49e1-999e-773a4faf026a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:21.992995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-889cdf2b-62b8-41d3-9f2f-babf2e3d508f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:21.993609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-889cdf2b-62b8-41d3-9f2f-babf2e3d508f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:21.994744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5ffc8332-bd10-49e1-999e-773a4faf026a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:21.995481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:22.001651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-889cdf2b-62b8-41d3-9f2f-babf2e3d508f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:22.002103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-889cdf2b-62b8-41d3-9f2f-babf2e3d508f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:22.003325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-889cdf2b-62b8-41d3-9f2f-babf2e3d508f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:22.003449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5ffc8332-bd10-49e1-999e-773a4faf026a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.157887 May 26 12:51:22.003574 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-889cdf2b-62b8-41d3-9f2f-babf2e3d508f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:22.003835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 194/423] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:21 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:22.133976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-889cdf2b-62b8-41d3-9f2f-babf2e3d508f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:22.142824 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-889cdf2b-62b8-41d3-9f2f-babf2e3d508f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.153672 May 26 12:51:22.143343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 230/424] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:21 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:22.453722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8093ba85-6a5f-4c8b-a37f-b0f2ba540494 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:22.454263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8093ba85-6a5f-4c8b-a37f-b0f2ba540494 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:22.460454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8093ba85-6a5f-4c8b-a37f-b0f2ba540494 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:22.460912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8093ba85-6a5f-4c8b-a37f-b0f2ba540494 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:22.461710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8093ba85-6a5f-4c8b-a37f-b0f2ba540494 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:22.462152 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8093ba85-6a5f-4c8b-a37f-b0f2ba540494 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:22.601821 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8093ba85-6a5f-4c8b-a37f-b0f2ba540494 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:22.609845 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8093ba85-6a5f-4c8b-a37f-b0f2ba540494 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.160299 May 26 12:51:22.610410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 195/425] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:22 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:23.020198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc474e7b-4d18-4c7c-b19f-182d407f9cf2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:23.021068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc474e7b-4d18-4c7c-b19f-182d407f9cf2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:23.028338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc474e7b-4d18-4c7c-b19f-182d407f9cf2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:23.028796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc474e7b-4d18-4c7c-b19f-182d407f9cf2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:23.029560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc474e7b-4d18-4c7c-b19f-182d407f9cf2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:23.030000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc474e7b-4d18-4c7c-b19f-182d407f9cf2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:23.158873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc474e7b-4d18-4c7c-b19f-182d407f9cf2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:23.160371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d24a863-0075-4e6c-8b94-9ae5db14db17 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:23.160984 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d24a863-0075-4e6c-8b94-9ae5db14db17 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:23.166405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc474e7b-4d18-4c7c-b19f-182d407f9cf2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.150034 May 26 12:51:23.167022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 231/426] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:23 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:23.178377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d24a863-0075-4e6c-8b94-9ae5db14db17 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:23.178377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d24a863-0075-4e6c-8b94-9ae5db14db17 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:23.178377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d24a863-0075-4e6c-8b94-9ae5db14db17 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:23.178377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d24a863-0075-4e6c-8b94-9ae5db14db17 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:23.304216 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d24a863-0075-4e6c-8b94-9ae5db14db17 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:23.313665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d24a863-0075-4e6c-8b94-9ae5db14db17 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1358 microversion: 2.1 time: 0.157604 May 26 12:51:23.314456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 196/427] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:23 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:23.627397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f31eccb-2ab1-454d-99e7-e048f6e8c3af tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:23.629872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f31eccb-2ab1-454d-99e7-e048f6e8c3af tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:23.634007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f31eccb-2ab1-454d-99e7-e048f6e8c3af tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:23.634453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f31eccb-2ab1-454d-99e7-e048f6e8c3af tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:23.635246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f31eccb-2ab1-454d-99e7-e048f6e8c3af tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:23.635680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f31eccb-2ab1-454d-99e7-e048f6e8c3af tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:23.768473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f31eccb-2ab1-454d-99e7-e048f6e8c3af tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:23.777133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f31eccb-2ab1-454d-99e7-e048f6e8c3af tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.153298 May 26 12:51:23.778060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 232/428] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:23 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:24.193019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7a0c2df2-5c86-4d79-bb8b-5d0ba0c83276 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:24.193634 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7a0c2df2-5c86-4d79-bb8b-5d0ba0c83276 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:24.200479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a0c2df2-5c86-4d79-bb8b-5d0ba0c83276 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.200930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a0c2df2-5c86-4d79-bb8b-5d0ba0c83276 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.201704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a0c2df2-5c86-4d79-bb8b-5d0ba0c83276 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.202144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a0c2df2-5c86-4d79-bb8b-5d0ba0c83276 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.330196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d42d4758-f51b-4e91-8bef-238ee3e08d6d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:24.330924 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d42d4758-f51b-4e91-8bef-238ee3e08d6d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:24.336818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42d4758-f51b-4e91-8bef-238ee3e08d6d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.337273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42d4758-f51b-4e91-8bef-238ee3e08d6d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.338038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42d4758-f51b-4e91-8bef-238ee3e08d6d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.338475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42d4758-f51b-4e91-8bef-238ee3e08d6d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.341081 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a0c2df2-5c86-4d79-bb8b-5d0ba0c83276 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:24.348590 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7a0c2df2-5c86-4d79-bb8b-5d0ba0c83276 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.159505 May 26 12:51:24.349154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 197/429] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:24 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:24.471089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d42d4758-f51b-4e91-8bef-238ee3e08d6d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:24.478458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d42d4758-f51b-4e91-8bef-238ee3e08d6d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1549 microversion: 2.1 time: 0.152074 May 26 12:51:24.479051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 233/430] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:24 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:24.495014 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bccead82-a82c-4b79-877a-183226d95355 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:24.495800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bccead82-a82c-4b79-877a-183226d95355 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:24.501826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bccead82-a82c-4b79-877a-183226d95355 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.502470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bccead82-a82c-4b79-877a-183226d95355 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.503265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bccead82-a82c-4b79-877a-183226d95355 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.503723 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bccead82-a82c-4b79-877a-183226d95355 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.710469 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bccead82-a82c-4b79-877a-183226d95355 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:24.719471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bccead82-a82c-4b79-877a-183226d95355 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1549 microversion: 2.1 time: 0.228386 May 26 12:51:24.720044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 198/431] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:24 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:24.735062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:24.738737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:24.739505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Searching by: {'deleted': False, 'project_id': 'b7059688f7a24761b61e51820c78a2ab'} {{(pid=124831) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 12:51:24.746129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.746677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.747476 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.747917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.794078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9214164-0bef-4fbf-9fb0-dcd893a6368b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:24.794712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9214164-0bef-4fbf-9fb0-dcd893a6368b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:24.800900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9214164-0bef-4fbf-9fb0-dcd893a6368b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.801384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9214164-0bef-4fbf-9fb0-dcd893a6368b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.802156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9214164-0bef-4fbf-9fb0-dcd893a6368b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.802671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9214164-0bef-4fbf-9fb0-dcd893a6368b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.839933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.multi_cell_list [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 12:51:24.933767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f219f4fb-24cc-4371-b567-afad5a4665c7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202506 May 26 12:51:24.933988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9214164-0bef-4fbf-9fb0-dcd893a6368b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:24.934426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 234/432] 10.222.0.60 () {58 vars in 1124 bytes} [Thu May 26 12:51:24 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:24.941504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9214164-0bef-4fbf-9fb0-dcd893a6368b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.151242 May 26 12:51:24.942060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 199/433] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:24 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:24.944222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e24e0927-c64d-4164-9224-2f593d705228 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:24.944836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e24e0927-c64d-4164-9224-2f593d705228 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:24.951903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e24e0927-c64d-4164-9224-2f593d705228 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.952361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e24e0927-c64d-4164-9224-2f593d705228 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:24.953132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e24e0927-c64d-4164-9224-2f593d705228 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:24.953574 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e24e0927-c64d-4164-9224-2f593d705228 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:25.081752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e24e0927-c64d-4164-9224-2f593d705228 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:25.089771 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e24e0927-c64d-4164-9224-2f593d705228 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1549 microversion: 2.1 time: 0.148610 May 26 12:51:25.090353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 235/434] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:24 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:25.370268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ec7b39af-0f4d-4f96-8f96-cc7527656eef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:25.371879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ec7b39af-0f4d-4f96-8f96-cc7527656eef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:25.377518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec7b39af-0f4d-4f96-8f96-cc7527656eef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:25.377971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec7b39af-0f4d-4f96-8f96-cc7527656eef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:25.379091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec7b39af-0f4d-4f96-8f96-cc7527656eef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:25.379526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec7b39af-0f4d-4f96-8f96-cc7527656eef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:25.525217 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec7b39af-0f4d-4f96-8f96-cc7527656eef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:25.533136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ec7b39af-0f4d-4f96-8f96-cc7527656eef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.171514 May 26 12:51:25.533705 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 200/435] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:25 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:25.958802 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c57f43a-609b-4d8f-b49f-ffe2c9a83fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:25.959352 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8c57f43a-609b-4d8f-b49f-ffe2c9a83fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:25.966268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c57f43a-609b-4d8f-b49f-ffe2c9a83fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:25.966766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c57f43a-609b-4d8f-b49f-ffe2c9a83fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:25.967543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c57f43a-609b-4d8f-b49f-ffe2c9a83fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:25.967986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c57f43a-609b-4d8f-b49f-ffe2c9a83fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:26.103414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8c57f43a-609b-4d8f-b49f-ffe2c9a83fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:26.111054 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8c57f43a-609b-4d8f-b49f-ffe2c9a83fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.156209 May 26 12:51:26.111620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 236/436] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:25 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:26.487882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2035927e-efe3-4271-967b-694f3342fb6e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: .version_select at 0x7f498c383040>, body: {"keypair": {"name": "tempest-keypair-1548722360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1gl5ovDKb9ly2wLISlmzdiQbOeXsYB6uM3sElvJcb5wLxcvgKO6R64g2cPSKserwRyN4RjUkS/YST5nZUc7FVQX/bzaSBBxGup4PsIDdxLqJsd3Wj9UYld/PZXnom+tA=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:26.491213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-622dbbc0-1423-4ec5-bff5-637289344f5f req-e2482f47-0d2b-4281-a7c8-574c8a9cd6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930f8e79-4127-485a-ba48-b2160b7f48d2", "name": "network-vif-plugged", "status": "completed", "tag": "8174c594-57a5-4fc2-a23c-4c496fc74df0"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:26.500184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-622dbbc0-1423-4ec5-bff5-637289344f5f req-e2482f47-0d2b-4281-a7c8-574c8a9cd6c2 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:26.500629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-622dbbc0-1423-4ec5-bff5-637289344f5f req-e2482f47-0d2b-4281-a7c8-574c8a9cd6c2 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:26.503358 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-2035927e-efe3-4271-967b-694f3342fb6e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:26.507406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-2035927e-efe3-4271-967b-694f3342fb6e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for user 98a275f65a3544a5b073fbf1ee10034b and project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:26.511322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-622dbbc0-1423-4ec5-bff5-637289344f5f req-e2482f47-0d2b-4281-a7c8-574c8a9cd6c2 service nova] Creating event network-vif-plugged:8174c594-57a5-4fc2-a23c-4c496fc74df0 for instance 930f8e79-4127-485a-ba48-b2160b7f48d2 on hv-cinder-81514 May 26 12:51:26.516262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-622dbbc0-1423-4ec5-bff5-637289344f5f req-e2482f47-0d2b-4281-a7c8-574c8a9cd6c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038111 May 26 12:51:26.517042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 201/437] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:26.550922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4bf955cb-47ee-48ea-9b18-077b261758e4 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:26.551609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4bf955cb-47ee-48ea-9b18-077b261758e4 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:26.558155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bf955cb-47ee-48ea-9b18-077b261758e4 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:26.559208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bf955cb-47ee-48ea-9b18-077b261758e4 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:26.560189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bf955cb-47ee-48ea-9b18-077b261758e4 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:26.568783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bf955cb-47ee-48ea-9b18-077b261758e4 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:26.627402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2035927e-efe3-4271-967b-694f3342fb6e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143317 May 26 12:51:26.628771 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 237/438] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 12:51:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:26.723939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4bf955cb-47ee-48ea-9b18-077b261758e4 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:26.726267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:26.732999 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4bf955cb-47ee-48ea-9b18-077b261758e4 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.186489 May 26 12:51:26.733959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 202/439] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:26 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:27.140466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1221859f-c282-4658-aae5-247654f07f5c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:27.141044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1221859f-c282-4658-aae5-247654f07f5c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:27.147328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1221859f-c282-4658-aae5-247654f07f5c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:27.147776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1221859f-c282-4658-aae5-247654f07f5c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:27.148526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1221859f-c282-4658-aae5-247654f07f5c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:27.148958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1221859f-c282-4658-aae5-247654f07f5c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:27.284699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1221859f-c282-4658-aae5-247654f07f5c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:27.293008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1221859f-c282-4658-aae5-247654f07f5c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.156333 May 26 12:51:27.294202 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 238/440] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:27 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:27.750930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1a12c37-e1e8-4810-a630-4c4c6cf75a62 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:27.751722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1a12c37-e1e8-4810-a630-4c4c6cf75a62 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:27.758747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1a12c37-e1e8-4810-a630-4c4c6cf75a62 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:27.759204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1a12c37-e1e8-4810-a630-4c4c6cf75a62 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:27.759980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1a12c37-e1e8-4810-a630-4c4c6cf75a62 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:27.760421 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1a12c37-e1e8-4810-a630-4c4c6cf75a62 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:27.911045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1a12c37-e1e8-4810-a630-4c4c6cf75a62 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:27.918622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1a12c37-e1e8-4810-a630-4c4c6cf75a62 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1273 microversion: 2.1 time: 0.172173 May 26 12:51:27.919132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 203/441] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:27 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:28.164833 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a588ceff-6377-4e5c-802b-c48e376034e8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11a81afd-720a-48bb-9ef7-efea04a1c941"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:28.165959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a588ceff-6377-4e5c-802b-c48e376034e8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:28.172358 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a588ceff-6377-4e5c-802b-c48e376034e8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.172721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a588ceff-6377-4e5c-802b-c48e376034e8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:28.173482 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a588ceff-6377-4e5c-802b-c48e376034e8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.173927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a588ceff-6377-4e5c-802b-c48e376034e8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:28.310442 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-916d349a-1b23-4b55-bec4-49200c3b41a1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:28.311148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-916d349a-1b23-4b55-bec4-49200c3b41a1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:28.317208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-916d349a-1b23-4b55-bec4-49200c3b41a1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.317664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-916d349a-1b23-4b55-bec4-49200c3b41a1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:28.318645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-916d349a-1b23-4b55-bec4-49200c3b41a1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.319090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-916d349a-1b23-4b55-bec4-49200c3b41a1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:28.542619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-916d349a-1b23-4b55-bec4-49200c3b41a1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:28.549854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-916d349a-1b23-4b55-bec4-49200c3b41a1 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.243421 May 26 12:51:28.550424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 204/442] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:28 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:28.935656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-940bd533-2b26-4faa-9cf4-9cbd090fb239 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:28.936397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-940bd533-2b26-4faa-9cf4-9cbd090fb239 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:28.943423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-940bd533-2b26-4faa-9cf4-9cbd090fb239 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.943882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-940bd533-2b26-4faa-9cf4-9cbd090fb239 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:28.944661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-940bd533-2b26-4faa-9cf4-9cbd090fb239 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.948793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-940bd533-2b26-4faa-9cf4-9cbd090fb239 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:29.020009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:29.107954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a588ceff-6377-4e5c-802b-c48e376034e8 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "POST /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947020 May 26 12:51:29.108750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 239/443] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:51:28 2022] POST /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments => generated 194 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:29.119893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-940bd533-2b26-4faa-9cf4-9cbd090fb239 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:29.127467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-940bd533-2b26-4faa-9cf4-9cbd090fb239 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.196092 May 26 12:51:29.128029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 205/444] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:28 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:29.241011 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-294158796", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6687087-b2c6-4c92-a8ec-55292a7bb20d"}], "security_groups": [{"name": "tempest-securitygroup--124652284"}], "key_name": "tempest-keypair-1548722360", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:29.351215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] validate_networks() for [('f6687087-b2c6-4c92-a8ec-55292a7bb20d', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:51:29.567326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dee6f3ef-727f-4e18-a800-9a6f215388ee tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:29.567846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dee6f3ef-727f-4e18-a800-9a6f215388ee tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:29.574873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dee6f3ef-727f-4e18-a800-9a6f215388ee tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:29.575324 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dee6f3ef-727f-4e18-a800-9a6f215388ee tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:29.576313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dee6f3ef-727f-4e18-a800-9a6f215388ee tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:29.576994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dee6f3ef-727f-4e18-a800-9a6f215388ee tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:29.723542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:51:29.723969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:51:29.724448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:51:29.724861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:51:29.725275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:51:29.734910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:29.735432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:29.736251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:29.736692 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:29.738836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dee6f3ef-727f-4e18-a800-9a6f215388ee tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:29.747150 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dee6f3ef-727f-4e18-a800-9a6f215388ee tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1314 microversion: 2.1 time: 0.183662 May 26 12:51:29.747969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 206/445] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:29 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:29.755084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:29.759044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for user 98a275f65a3544a5b073fbf1ee10034b and project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:29.770622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:51:29.773046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:51:29.923984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b7f1819e-1f21-484b-9bcf-62542ac5d0af tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.688255 May 26 12:51:29.924638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 240/446] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:51:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:51:29.935523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6175225f-daaa-42a3-9874-10b0f4bcec73 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:29.936165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6175225f-daaa-42a3-9874-10b0f4bcec73 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:29.998980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6175225f-daaa-42a3-9874-10b0f4bcec73 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:30.009490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6175225f-daaa-42a3-9874-10b0f4bcec73 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1241 microversion: 2.1 time: 0.078485 May 26 12:51:30.010448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 207/447] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:29 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:30.145659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4db5c3bd-d9ba-4026-a9e1-7aaeb99af51f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:30.146261 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4db5c3bd-d9ba-4026-a9e1-7aaeb99af51f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:30.153378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db5c3bd-d9ba-4026-a9e1-7aaeb99af51f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:30.153926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db5c3bd-d9ba-4026-a9e1-7aaeb99af51f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:30.154732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db5c3bd-d9ba-4026-a9e1-7aaeb99af51f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:30.155168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db5c3bd-d9ba-4026-a9e1-7aaeb99af51f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:30.298325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4db5c3bd-d9ba-4026-a9e1-7aaeb99af51f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:30.305799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4db5c3bd-d9ba-4026-a9e1-7aaeb99af51f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.164339 May 26 12:51:30.306354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 241/448] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:30 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:30.764526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-144199ff-ec4a-4832-aa0d-49b834575dfe tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:30.765146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-144199ff-ec4a-4832-aa0d-49b834575dfe tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:30.772206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-144199ff-ec4a-4832-aa0d-49b834575dfe tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:30.772661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-144199ff-ec4a-4832-aa0d-49b834575dfe tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:30.773426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-144199ff-ec4a-4832-aa0d-49b834575dfe tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:30.773864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-144199ff-ec4a-4832-aa0d-49b834575dfe tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:30.920931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-144199ff-ec4a-4832-aa0d-49b834575dfe tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:30.928551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-144199ff-ec4a-4832-aa0d-49b834575dfe tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1499 microversion: 2.1 time: 0.168655 May 26 12:51:30.929128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 208/449] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:30 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:31.028395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-06fc7643-341c-4c78-8b16-42aa5321eed8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:31.029002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-06fc7643-341c-4c78-8b16-42aa5321eed8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:31.035485 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06fc7643-341c-4c78-8b16-42aa5321eed8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.035920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06fc7643-341c-4c78-8b16-42aa5321eed8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.036674 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06fc7643-341c-4c78-8b16-42aa5321eed8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.037105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06fc7643-341c-4c78-8b16-42aa5321eed8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.099710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-06fc7643-341c-4c78-8b16-42aa5321eed8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:31.107337 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-06fc7643-341c-4c78-8b16-42aa5321eed8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1245 microversion: 2.1 time: 0.082842 May 26 12:51:31.107911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 242/450] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:31 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:31.322013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-48a00029-db6f-427d-bcda-d8ab6915b271 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:31.322663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-48a00029-db6f-427d-bcda-d8ab6915b271 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:31.330177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48a00029-db6f-427d-bcda-d8ab6915b271 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.330672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48a00029-db6f-427d-bcda-d8ab6915b271 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.331676 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48a00029-db6f-427d-bcda-d8ab6915b271 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.331887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48a00029-db6f-427d-bcda-d8ab6915b271 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.474306 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-48a00029-db6f-427d-bcda-d8ab6915b271 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:31.482122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-48a00029-db6f-427d-bcda-d8ab6915b271 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.164095 May 26 12:51:31.482727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 209/451] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:31 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:32.124745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4ea42d9a-b299-4967-9e05-9e20ec3dd9dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:32.125303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4ea42d9a-b299-4967-9e05-9e20ec3dd9dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:32.132384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ea42d9a-b299-4967-9e05-9e20ec3dd9dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.132971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ea42d9a-b299-4967-9e05-9e20ec3dd9dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.134688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ea42d9a-b299-4967-9e05-9e20ec3dd9dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.134688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ea42d9a-b299-4967-9e05-9e20ec3dd9dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.156182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-083162e9-6d5e-4b10-a162-ad92d63ccbcd tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:32.156678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-083162e9-6d5e-4b10-a162-ad92d63ccbcd tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:32.162917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-083162e9-6d5e-4b10-a162-ad92d63ccbcd tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.163378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-083162e9-6d5e-4b10-a162-ad92d63ccbcd tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.164155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-083162e9-6d5e-4b10-a162-ad92d63ccbcd tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.164595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-083162e9-6d5e-4b10-a162-ad92d63ccbcd tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.191631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-083162e9-6d5e-4b10-a162-ad92d63ccbcd tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:51:32.205556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4ea42d9a-b299-4967-9e05-9e20ec3dd9dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:32.213015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4ea42d9a-b299-4967-9e05-9e20ec3dd9dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1293 microversion: 2.1 time: 0.092628 May 26 12:51:32.213586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 243/452] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:32 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:32.499393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e92ace1f-0323-415b-9aab-03b156e5af11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:32.499996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e92ace1f-0323-415b-9aab-03b156e5af11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:32.505919 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e92ace1f-0323-415b-9aab-03b156e5af11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.506364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e92ace1f-0323-415b-9aab-03b156e5af11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.507177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e92ace1f-0323-415b-9aab-03b156e5af11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.507592 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e92ace1f-0323-415b-9aab-03b156e5af11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.562901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-083162e9-6d5e-4b10-a162-ad92d63ccbcd tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "DELETE /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 204 len: 0 microversion: 2.1 time: 0.410268 May 26 12:51:32.567147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 210/453] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:51:32 2022] DELETE /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:51:32.572969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-27faab94-f51a-4656-b6fc-d7bd1e2d28c0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:32.573923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-27faab94-f51a-4656-b6fc-d7bd1e2d28c0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:32.580715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27faab94-f51a-4656-b6fc-d7bd1e2d28c0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.581163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27faab94-f51a-4656-b6fc-d7bd1e2d28c0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.582566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27faab94-f51a-4656-b6fc-d7bd1e2d28c0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.583011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27faab94-f51a-4656-b6fc-d7bd1e2d28c0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.648153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e92ace1f-0323-415b-9aab-03b156e5af11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:32.656682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e92ace1f-0323-415b-9aab-03b156e5af11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.161407 May 26 12:51:32.666727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 244/454] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:32 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:32.787111 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27faab94-f51a-4656-b6fc-d7bd1e2d28c0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:32.794718 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-27faab94-f51a-4656-b6fc-d7bd1e2d28c0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1505 microversion: 2.1 time: 0.226109 May 26 12:51:32.795285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 211/455] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:32 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:33.237595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66813b53-3849-4446-a3ef-62085d29ff8f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:33.238227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-66813b53-3849-4446-a3ef-62085d29ff8f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:33.245973 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66813b53-3849-4446-a3ef-62085d29ff8f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:33.246424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66813b53-3849-4446-a3ef-62085d29ff8f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.247253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66813b53-3849-4446-a3ef-62085d29ff8f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:33.248026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66813b53-3849-4446-a3ef-62085d29ff8f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.400397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66813b53-3849-4446-a3ef-62085d29ff8f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:33.409391 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-66813b53-3849-4446-a3ef-62085d29ff8f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.175914 May 26 12:51:33.410254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 245/456] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:33 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:33.674512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f5890f0-591e-4574-a6a2-8a5c8d9465db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:33.675148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f5890f0-591e-4574-a6a2-8a5c8d9465db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:33.681585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f5890f0-591e-4574-a6a2-8a5c8d9465db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:33.682034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f5890f0-591e-4574-a6a2-8a5c8d9465db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.683443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f5890f0-591e-4574-a6a2-8a5c8d9465db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:33.683878 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f5890f0-591e-4574-a6a2-8a5c8d9465db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.812955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-47d47da5-8e99-4f77-99a2-ae37ed5aae55 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:33.813681 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-47d47da5-8e99-4f77-99a2-ae37ed5aae55 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:33.819952 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47d47da5-8e99-4f77-99a2-ae37ed5aae55 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:33.820404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47d47da5-8e99-4f77-99a2-ae37ed5aae55 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.821168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47d47da5-8e99-4f77-99a2-ae37ed5aae55 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:33.821604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47d47da5-8e99-4f77-99a2-ae37ed5aae55 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.823530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f5890f0-591e-4574-a6a2-8a5c8d9465db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:33.830947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f5890f0-591e-4574-a6a2-8a5c8d9465db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.160304 May 26 12:51:33.831518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 212/457] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:33 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:33.959093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-47d47da5-8e99-4f77-99a2-ae37ed5aae55 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:33.967616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-47d47da5-8e99-4f77-99a2-ae37ed5aae55 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1505 microversion: 2.1 time: 0.158336 May 26 12:51:33.968274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 246/458] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:33 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:34.429067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-363cc967-1f22-4bc2-a6b9-dbc1087ad86f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:34.429818 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-363cc967-1f22-4bc2-a6b9-dbc1087ad86f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:34.436223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363cc967-1f22-4bc2-a6b9-dbc1087ad86f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.436681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363cc967-1f22-4bc2-a6b9-dbc1087ad86f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:34.437465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363cc967-1f22-4bc2-a6b9-dbc1087ad86f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.437910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363cc967-1f22-4bc2-a6b9-dbc1087ad86f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:34.651742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-363cc967-1f22-4bc2-a6b9-dbc1087ad86f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:34.659240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-363cc967-1f22-4bc2-a6b9-dbc1087ad86f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.234065 May 26 12:51:34.659889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 213/459] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:34 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:34.849462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a48a18a8-9851-48cd-b3e8-c293ad6b6fc5 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:34.851557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a48a18a8-9851-48cd-b3e8-c293ad6b6fc5 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:34.858897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a48a18a8-9851-48cd-b3e8-c293ad6b6fc5 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.859538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a48a18a8-9851-48cd-b3e8-c293ad6b6fc5 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:34.860493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a48a18a8-9851-48cd-b3e8-c293ad6b6fc5 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.861074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a48a18a8-9851-48cd-b3e8-c293ad6b6fc5 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:34.943578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-307ee6ed-30e8-477e-846e-bef19fed5446 req-17722d09-1386-4fdb-810d-d202f889f7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e6512b-4f9a-4929-9cdf-099229ccd261", "tag": "8854eb96-6221-4bab-b9c6-0ed3e07047a4"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:34.955191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-307ee6ed-30e8-477e-846e-bef19fed5446 req-17722d09-1386-4fdb-810d-d202f889f7e0 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.955875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-307ee6ed-30e8-477e-846e-bef19fed5446 req-17722d09-1386-4fdb-810d-d202f889f7e0 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:34.976476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-307ee6ed-30e8-477e-846e-bef19fed5446 req-17722d09-1386-4fdb-810d-d202f889f7e0 service nova] Creating event network-changed:8854eb96-6221-4bab-b9c6-0ed3e07047a4 for instance c8e6512b-4f9a-4929-9cdf-099229ccd261 on hv-cinder-81514 May 26 12:51:34.988170 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-307ee6ed-30e8-477e-846e-bef19fed5446 req-17722d09-1386-4fdb-810d-d202f889f7e0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048076 May 26 12:51:34.989371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 214/460] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:51:34.996382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05d77e8d-d537-4bd8-b747-d1dabe5b3b93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:34.997384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05d77e8d-d537-4bd8-b747-d1dabe5b3b93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:35.004658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d77e8d-d537-4bd8-b747-d1dabe5b3b93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.005398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d77e8d-d537-4bd8-b747-d1dabe5b3b93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.006357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d77e8d-d537-4bd8-b747-d1dabe5b3b93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.007011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d77e8d-d537-4bd8-b747-d1dabe5b3b93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.058227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a48a18a8-9851-48cd-b3e8-c293ad6b6fc5 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:35.066049 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a48a18a8-9851-48cd-b3e8-c293ad6b6fc5 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.221436 May 26 12:51:35.066643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 247/461] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:34 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:35.265581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05d77e8d-d537-4bd8-b747-d1dabe5b3b93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:35.274035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05d77e8d-d537-4bd8-b747-d1dabe5b3b93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1505 microversion: 2.1 time: 0.283317 May 26 12:51:35.284724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 215/462] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:34 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:35.676694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71db43d9-037b-407f-955a-6846090ee1c4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:35.677341 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-71db43d9-037b-407f-955a-6846090ee1c4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:35.684165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71db43d9-037b-407f-955a-6846090ee1c4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.684610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71db43d9-037b-407f-955a-6846090ee1c4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.685368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71db43d9-037b-407f-955a-6846090ee1c4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.685793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71db43d9-037b-407f-955a-6846090ee1c4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.818319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-71db43d9-037b-407f-955a-6846090ee1c4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:35.825882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-71db43d9-037b-407f-955a-6846090ee1c4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.153609 May 26 12:51:35.826455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 248/463] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:35 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:36.083516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eeaf953d-b69c-4fd0-970c-b08ce70b5c85 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:36.084154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eeaf953d-b69c-4fd0-970c-b08ce70b5c85 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:36.091618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeaf953d-b69c-4fd0-970c-b08ce70b5c85 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:36.092080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeaf953d-b69c-4fd0-970c-b08ce70b5c85 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:36.092864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeaf953d-b69c-4fd0-970c-b08ce70b5c85 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:36.093302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeaf953d-b69c-4fd0-970c-b08ce70b5c85 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:36.234476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eeaf953d-b69c-4fd0-970c-b08ce70b5c85 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:36.242041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eeaf953d-b69c-4fd0-970c-b08ce70b5c85 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.162354 May 26 12:51:36.242603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 216/464] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:36 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:36.291801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-698623b1-92e7-4a07-823b-964fbc0e9f6b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:36.292438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-698623b1-92e7-4a07-823b-964fbc0e9f6b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:36.298897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698623b1-92e7-4a07-823b-964fbc0e9f6b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:36.299400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698623b1-92e7-4a07-823b-964fbc0e9f6b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:36.300271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698623b1-92e7-4a07-823b-964fbc0e9f6b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:36.300712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698623b1-92e7-4a07-823b-964fbc0e9f6b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:36.362165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-698623b1-92e7-4a07-823b-964fbc0e9f6b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:36.370505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-698623b1-92e7-4a07-823b-964fbc0e9f6b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1299 microversion: 2.1 time: 0.082026 May 26 12:51:36.371115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 249/465] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:36 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:36.843264 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dde49871-5db4-4aa8-a669-f612ac5c2666 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:36.843871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dde49871-5db4-4aa8-a669-f612ac5c2666 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:36.849737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dde49871-5db4-4aa8-a669-f612ac5c2666 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:36.850183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dde49871-5db4-4aa8-a669-f612ac5c2666 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:36.850979 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dde49871-5db4-4aa8-a669-f612ac5c2666 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:36.851413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dde49871-5db4-4aa8-a669-f612ac5c2666 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:36.985274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dde49871-5db4-4aa8-a669-f612ac5c2666 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:36.992631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dde49871-5db4-4aa8-a669-f612ac5c2666 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.153370 May 26 12:51:36.993191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 217/466] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:36 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:37.003264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-d7609106-d408-4462-960d-ee7cd0f56dbd req-a7929088-06f7-4e61-8998-309a006a9bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930f8e79-4127-485a-ba48-b2160b7f48d2", "name": "network-vif-deleted", "tag": "8174c594-57a5-4fc2-a23c-4c496fc74df0"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:37.012079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d7609106-d408-4462-960d-ee7cd0f56dbd req-a7929088-06f7-4e61-8998-309a006a9bb6 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.012526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d7609106-d408-4462-960d-ee7cd0f56dbd req-a7929088-06f7-4e61-8998-309a006a9bb6 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.023098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-d7609106-d408-4462-960d-ee7cd0f56dbd req-a7929088-06f7-4e61-8998-309a006a9bb6 service nova] Creating event network-vif-deleted:8174c594-57a5-4fc2-a23c-4c496fc74df0 for instance 930f8e79-4127-485a-ba48-b2160b7f48d2 on hv-cinder-81514 May 26 12:51:37.028936 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-d7609106-d408-4462-960d-ee7cd0f56dbd req-a7929088-06f7-4e61-8998-309a006a9bb6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029358 May 26 12:51:37.029511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 250/467] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:37.259264 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e048a3a9-40f7-420c-a506-3fa506a496ef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:37.259877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e048a3a9-40f7-420c-a506-3fa506a496ef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:37.267225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e048a3a9-40f7-420c-a506-3fa506a496ef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.267674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e048a3a9-40f7-420c-a506-3fa506a496ef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.268483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e048a3a9-40f7-420c-a506-3fa506a496ef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.269221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e048a3a9-40f7-420c-a506-3fa506a496ef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.388769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2803e2ae-1e63-43d3-966f-2cc6e86110b3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:37.389472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2803e2ae-1e63-43d3-966f-2cc6e86110b3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:37.395926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2803e2ae-1e63-43d3-966f-2cc6e86110b3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.396382 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2803e2ae-1e63-43d3-966f-2cc6e86110b3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.397154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2803e2ae-1e63-43d3-966f-2cc6e86110b3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.397598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2803e2ae-1e63-43d3-966f-2cc6e86110b3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.400819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e048a3a9-40f7-420c-a506-3fa506a496ef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:37.409032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e048a3a9-40f7-420c-a506-3fa506a496ef tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.153657 May 26 12:51:37.409702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 218/468] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:37 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:37.458641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2803e2ae-1e63-43d3-966f-2cc6e86110b3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:37.466778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2803e2ae-1e63-43d3-966f-2cc6e86110b3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1299 microversion: 2.1 time: 0.083186 May 26 12:51:37.467347 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 251/469] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:37 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:38.009102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-275a8a9b-52e0-40d9-8008-12c91f557633 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:38.009713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-275a8a9b-52e0-40d9-8008-12c91f557633 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:38.016017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-275a8a9b-52e0-40d9-8008-12c91f557633 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.016482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-275a8a9b-52e0-40d9-8008-12c91f557633 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.017255 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-275a8a9b-52e0-40d9-8008-12c91f557633 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.017699 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-275a8a9b-52e0-40d9-8008-12c91f557633 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.032451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:38.150508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-275a8a9b-52e0-40d9-8008-12c91f557633 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:38.158089 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-275a8a9b-52e0-40d9-8008-12c91f557633 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.152812 May 26 12:51:38.159454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 219/470] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:38 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:38.428031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bbfd94b5-fb71-478f-9dd2-068236b9133f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:38.429232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bbfd94b5-fb71-478f-9dd2-068236b9133f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:38.436533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbfd94b5-fb71-478f-9dd2-068236b9133f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.437467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbfd94b5-fb71-478f-9dd2-068236b9133f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.438474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbfd94b5-fb71-478f-9dd2-068236b9133f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.438933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbfd94b5-fb71-478f-9dd2-068236b9133f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.484502 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:38.485119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:38.492360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.492818 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.493615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.494046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.526946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.527413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.527865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lazy-loading 'fault' on Instance uuid 930f8e79-4127-485a-ba48-b2160b7f48d2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:38.573517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:38.581025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-88261085-1533-4d74-9255-201ae2e48c93 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1304 microversion: 2.1 time: 0.100574 May 26 12:51:38.581588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 220/471] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:38 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:38.586071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bbfd94b5-fb71-478f-9dd2-068236b9133f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:38.595147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bbfd94b5-fb71-478f-9dd2-068236b9133f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.173067 May 26 12:51:38.595721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 252/472] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:38 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:39.176056 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4bfaf867-4b4e-49ae-acc3-ea14ab51132f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:39.176794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4bfaf867-4b4e-49ae-acc3-ea14ab51132f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:39.183411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bfaf867-4b4e-49ae-acc3-ea14ab51132f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.183938 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bfaf867-4b4e-49ae-acc3-ea14ab51132f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.184713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bfaf867-4b4e-49ae-acc3-ea14ab51132f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.185154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bfaf867-4b4e-49ae-acc3-ea14ab51132f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.321412 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4bfaf867-4b4e-49ae-acc3-ea14ab51132f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:39.329911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4bfaf867-4b4e-49ae-acc3-ea14ab51132f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.157751 May 26 12:51:39.330726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 221/473] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:39 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:39.598944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:39.599583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:39.606858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.607361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.608130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.608564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.612645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1838a4b5-49be-4bc7-96e4-1eb8cbf2824f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:39.613341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1838a4b5-49be-4bc7-96e4-1eb8cbf2824f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:39.620037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1838a4b5-49be-4bc7-96e4-1eb8cbf2824f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.620555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1838a4b5-49be-4bc7-96e4-1eb8cbf2824f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.621416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1838a4b5-49be-4bc7-96e4-1eb8cbf2824f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.621917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1838a4b5-49be-4bc7-96e4-1eb8cbf2824f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.639280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.639722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.640166 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lazy-loading 'fault' on Instance uuid 930f8e79-4127-485a-ba48-b2160b7f48d2 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:39.681008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:39.688854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd7b8dfe-8911-4dde-b134-a16f2585db15 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1304 microversion: 2.1 time: 0.093766 May 26 12:51:39.689421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 253/474] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:39 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:39.754709 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1838a4b5-49be-4bc7-96e4-1eb8cbf2824f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:39.762757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1838a4b5-49be-4bc7-96e4-1eb8cbf2824f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.154094 May 26 12:51:39.763313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 222/475] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:39 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:40.349895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a75792c-6790-4d6e-af47-aaa315698d18 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:40.350421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a75792c-6790-4d6e-af47-aaa315698d18 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:40.352440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:40.353091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:40.358615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a75792c-6790-4d6e-af47-aaa315698d18 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.359064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a75792c-6790-4d6e-af47-aaa315698d18 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.359839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a75792c-6790-4d6e-af47-aaa315698d18 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.360270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a75792c-6790-4d6e-af47-aaa315698d18 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.489263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a75792c-6790-4d6e-af47-aaa315698d18 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:40.497640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a75792c-6790-4d6e-af47-aaa315698d18 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.151694 May 26 12:51:40.498206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 254/476] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:40 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:40.706044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:40.706689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:40.708533 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:40.714569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.715123 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.715899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.716839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.747644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.748098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.748665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lazy-loading 'fault' on Instance uuid 930f8e79-4127-485a-ba48-b2160b7f48d2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:40.780010 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-67dcbbca-46cd-488a-88e3-4afef7ee543f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:40.780647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-67dcbbca-46cd-488a-88e3-4afef7ee543f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:40.787419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67dcbbca-46cd-488a-88e3-4afef7ee543f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.788996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67dcbbca-46cd-488a-88e3-4afef7ee543f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.788996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67dcbbca-46cd-488a-88e3-4afef7ee543f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.789193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:40.789311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67dcbbca-46cd-488a-88e3-4afef7ee543f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.797696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89cd8f1b-90da-4661-86a1-528543af0807 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1304 microversion: 2.1 time: 0.095458 May 26 12:51:40.798275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 223/477] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:40 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:40.929853 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-67dcbbca-46cd-488a-88e3-4afef7ee543f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:40.937865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-67dcbbca-46cd-488a-88e3-4afef7ee543f tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.161592 May 26 12:51:40.938505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 255/478] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:40 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:41.017793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-f1849735-55ac-4b2f-a7ca-187069a7b98e req-d8155c57-38c5-4ae0-9aca-f047d5d85c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a12be-8748-41ab-a6a4-17d666ea34d0", "name": "network-vif-plugged", "status": "completed", "tag": "e5d66805-9eb5-4134-a395-25cf61316cc2"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:41.028407 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-f1849735-55ac-4b2f-a7ca-187069a7b98e req-d8155c57-38c5-4ae0-9aca-f047d5d85c38 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.028862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-f1849735-55ac-4b2f-a7ca-187069a7b98e req-d8155c57-38c5-4ae0-9aca-f047d5d85c38 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.041268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-f1849735-55ac-4b2f-a7ca-187069a7b98e req-d8155c57-38c5-4ae0-9aca-f047d5d85c38 service nova] Creating event network-vif-plugged:e5d66805-9eb5-4134-a395-25cf61316cc2 for instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 on hv-cinder-81514 May 26 12:51:41.046059 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-f1849735-55ac-4b2f-a7ca-187069a7b98e req-d8155c57-38c5-4ae0-9aca-f047d5d85c38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032320 May 26 12:51:41.046666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 224/479] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:41.515156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4114456c-fd9b-4323-9229-bdcd10b59617 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:41.515652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4114456c-fd9b-4323-9229-bdcd10b59617 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:41.521863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4114456c-fd9b-4323-9229-bdcd10b59617 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.522313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4114456c-fd9b-4323-9229-bdcd10b59617 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.523100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4114456c-fd9b-4323-9229-bdcd10b59617 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.523537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4114456c-fd9b-4323-9229-bdcd10b59617 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.650862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4114456c-fd9b-4323-9229-bdcd10b59617 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:41.658257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4114456c-fd9b-4323-9229-bdcd10b59617 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.147056 May 26 12:51:41.658851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 256/480] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:41 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:41.815256 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:41.815940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:41.822848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.823298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.824064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.824502 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.854732 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.855185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.855629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lazy-loading 'fault' on Instance uuid 930f8e79-4127-485a-ba48-b2160b7f48d2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:41.895895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:41.903516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5485e606-1dd5-44e0-af44-c38fd7bfdaec tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1304 microversion: 2.1 time: 0.092823 May 26 12:51:41.904076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 225/481] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:41 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:41.954142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c13cd2f-925f-43ce-b3fe-4002b08d9272 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:41.954779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8c13cd2f-925f-43ce-b3fe-4002b08d9272 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:41.961331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c13cd2f-925f-43ce-b3fe-4002b08d9272 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.961784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c13cd2f-925f-43ce-b3fe-4002b08d9272 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.962565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c13cd2f-925f-43ce-b3fe-4002b08d9272 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.963033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c13cd2f-925f-43ce-b3fe-4002b08d9272 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.981203 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:42.097089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8c13cd2f-925f-43ce-b3fe-4002b08d9272 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:42.105183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8c13cd2f-925f-43ce-b3fe-4002b08d9272 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.154833 May 26 12:51:42.105752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 257/482] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:41 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:42.675981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c12a3f55-4665-4f3c-830a-b8ffb1b69156 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:42.676620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c12a3f55-4665-4f3c-830a-b8ffb1b69156 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:42.682821 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c12a3f55-4665-4f3c-830a-b8ffb1b69156 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.683280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c12a3f55-4665-4f3c-830a-b8ffb1b69156 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.684049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c12a3f55-4665-4f3c-830a-b8ffb1b69156 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.684485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c12a3f55-4665-4f3c-830a-b8ffb1b69156 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.919969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:42.920578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:42.924441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c12a3f55-4665-4f3c-830a-b8ffb1b69156 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:42.928344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.929080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.930080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.930751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.934853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c12a3f55-4665-4f3c-830a-b8ffb1b69156 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.262831 May 26 12:51:42.944015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 226/483] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:42 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:42.974382 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.974875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.975298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lazy-loading 'fault' on Instance uuid 930f8e79-4127-485a-ba48-b2160b7f48d2 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:43.023039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:43.030917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-83e0a65d-4d3e-407f-9660-c141e7b322c3 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 200 len: 1304 microversion: 2.1 time: 0.114855 May 26 12:51:43.031634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 258/484] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:42 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:43.122705 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b14b3f4-290b-4e77-a1f4-468a17054c9b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:43.123669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b14b3f4-290b-4e77-a1f4-468a17054c9b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:43.131547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b14b3f4-290b-4e77-a1f4-468a17054c9b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:43.132098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b14b3f4-290b-4e77-a1f4-468a17054c9b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:43.133204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b14b3f4-290b-4e77-a1f4-468a17054c9b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:43.133873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b14b3f4-290b-4e77-a1f4-468a17054c9b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:43.312283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b14b3f4-290b-4e77-a1f4-468a17054c9b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:43.321904 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b14b3f4-290b-4e77-a1f4-468a17054c9b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.204523 May 26 12:51:43.322503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 227/485] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:43 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:43.418209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2be0dacb-90bf-4ecc-a0de-7ed4c2df6d14 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:43.418856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2be0dacb-90bf-4ecc-a0de-7ed4c2df6d14 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:43.424838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2be0dacb-90bf-4ecc-a0de-7ed4c2df6d14 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:43.425296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2be0dacb-90bf-4ecc-a0de-7ed4c2df6d14 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:43.426065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2be0dacb-90bf-4ecc-a0de-7ed4c2df6d14 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:43.426506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2be0dacb-90bf-4ecc-a0de-7ed4c2df6d14 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:43.558259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2be0dacb-90bf-4ecc-a0de-7ed4c2df6d14 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:43.566246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2be0dacb-90bf-4ecc-a0de-7ed4c2df6d14 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1595 microversion: 2.1 time: 0.152500 May 26 12:51:43.566852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 259/486] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:43 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:43.951705 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-276143a4-c208-4bdc-a393-7aa78aa85675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:43.952315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-276143a4-c208-4bdc-a393-7aa78aa85675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:43.958773 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-276143a4-c208-4bdc-a393-7aa78aa85675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:43.959363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-276143a4-c208-4bdc-a393-7aa78aa85675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:43.960064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-276143a4-c208-4bdc-a393-7aa78aa85675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:43.960493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-276143a4-c208-4bdc-a393-7aa78aa85675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.047944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:44.048578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 930f8e79-4127-485a-ba48-b2160b7f48d2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:44.055280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.055798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.056649 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.057480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.071293 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] HTTP exception thrown: Instance 930f8e79-4127-485a-ba48-b2160b7f48d2 could not be found. May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Request method failure captured: May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 HTTP/1.1 May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3ept5uy7aM8DNCS_4Rue8bS8STkLDkWC8v5ai_rjRy-VqmcsomlGDooS1B1unnn3Y49giHSXHfO0d1KRIG_dU1y-Vaeo2qULJdz4kBpHb82S1ikABrLMz9CnStTI6hYO87a1a3YrRwNOWwDQlyFBV3RVwCM98LTFq561d0LOrP4ZXM May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: b2c3cf0851794497aac57c9d2fbfc6da May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesActionsTest-529444128 May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:51:44.073745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b2c3cf0851794497aac57c9d2fbfc6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b2c3cf0851794497aac57c9d2fbfc6da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b2c3cf0851794497aac57c9d2fbfc6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b2c3cf0851794497aac57c9d2fbfc6da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesActionsTest-529444128 May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: b2c3cf0851794497aac57c9d2fbfc6da May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesActionsTest-529444128 May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesActionsTest-529444128-project May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: b1933169d9a94afb9393d35f3a523c25 May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesActionsTest-529444128-project May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 930f8e79-4127-485a-ba48-b2160b7f48d2 could not be found. May 26 12:51:44.087819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '930f8e79-4127-485a-ba48-b2160b7f48d2'} May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 930f8e79-4127-485a-ba48-b2160b7f48d2 could not be found. May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:51:44.090002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930f8e79-4127-485a-ba48-b2160b7f48d2 could not be found. May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930f8e79-4127-485a-ba48-b2160b7f48d2 could not be found. May 26 12:51:44.092774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:51:44.094746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Returning 404 to user: Instance 930f8e79-4127-485a-ba48-b2160b7f48d2 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:51:44.094746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ea75243-4b86-4326-ac0d-3dc9cc8c1fa4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2" status: 404 len: 111 microversion: 2.1 time: 0.030948 May 26 12:51:44.094746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 260/487] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:44 2022] GET /compute/v2.1/servers/930f8e79-4127-485a-ba48-b2160b7f48d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:51:44.104266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-276143a4-c208-4bdc-a393-7aa78aa85675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:44.113200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-276143a4-c208-4bdc-a393-7aa78aa85675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.166183 May 26 12:51:44.114097 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 228/488] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:43 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:44.186182 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1078953474", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "networks": [{"uuid": "cd04a690-5cf5-4c3b-ba42-b7e5946b37c4"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:44.242337 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] validate_networks() for [('cd04a690-5cf5-4c3b-ba42-b7e5946b37c4', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:51:44.372187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc887068-9f18-42fa-8a37-2893317c9953 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:44.372187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc887068-9f18-42fa-8a37-2893317c9953 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:44.372187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:44.372187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc887068-9f18-42fa-8a37-2893317c9953 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.372187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc887068-9f18-42fa-8a37-2893317c9953 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.373586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc887068-9f18-42fa-8a37-2893317c9953 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.373586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc887068-9f18-42fa-8a37-2893317c9953 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.498138 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc887068-9f18-42fa-8a37-2893317c9953 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:44.505958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc887068-9f18-42fa-8a37-2893317c9953 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1261 microversion: 2.1 time: 0.170686 May 26 12:51:44.506560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 229/489] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:44 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:44.780816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:51:44.781315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:51:44.781895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:51:44.782375 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:51:44.782901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:51:44.792660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.793191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.794068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.794617 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.811780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Getting quotas for project b2c3cf0851794497aac57c9d2fbfc6da. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:44.815921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Getting quotas for user b1933169d9a94afb9393d35f3a523c25 and project b2c3cf0851794497aac57c9d2fbfc6da. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:44.818295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:44.827799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:51:44.837794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:51:44.950579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c4b0aae5-4ed1-4f82-a089-cf8aa234450d tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769259 May 26 12:51:44.951423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 261/490] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:51:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:51:44.961653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c36f9e7-7cb6-41ba-a2b4-b989bbadb460 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:44.962423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c36f9e7-7cb6-41ba-a2b4-b989bbadb460 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:45.038284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c36f9e7-7cb6-41ba-a2b4-b989bbadb460 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:45.038284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c36f9e7-7cb6-41ba-a2b4-b989bbadb460 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1214 microversion: 2.1 time: 0.079884 May 26 12:51:45.038284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 230/491] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:44 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:45.131041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c7520d7-6c37-44e8-a08a-17d1097f7f8a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:45.131661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c7520d7-6c37-44e8-a08a-17d1097f7f8a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:45.138734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c7520d7-6c37-44e8-a08a-17d1097f7f8a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.139190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c7520d7-6c37-44e8-a08a-17d1097f7f8a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.140034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c7520d7-6c37-44e8-a08a-17d1097f7f8a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.140468 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c7520d7-6c37-44e8-a08a-17d1097f7f8a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.524079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-325384a2-1fed-41ba-8d12-4555aef526cd tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:45.524724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-325384a2-1fed-41ba-8d12-4555aef526cd tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:45.532536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-325384a2-1fed-41ba-8d12-4555aef526cd tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.533118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-325384a2-1fed-41ba-8d12-4555aef526cd tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.535527 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-325384a2-1fed-41ba-8d12-4555aef526cd tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.535527 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-325384a2-1fed-41ba-8d12-4555aef526cd tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.581861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c7520d7-6c37-44e8-a08a-17d1097f7f8a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:45.599272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c7520d7-6c37-44e8-a08a-17d1097f7f8a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.472210 May 26 12:51:45.600583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 262/492] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:45 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:45.694855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-325384a2-1fed-41ba-8d12-4555aef526cd tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:45.703113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-325384a2-1fed-41ba-8d12-4555aef526cd tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1445 microversion: 2.1 time: 0.183351 May 26 12:51:45.703798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 231/493] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:45 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:45.716193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-5c9cea15-471a-4eb5-9d8e-9e677bd0a9b9 req-572d9c6c-612c-44f0-a144-7c19ebd909a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e6512b-4f9a-4929-9cdf-099229ccd261", "name": "network-vif-plugged", "status": "completed", "tag": "8854eb96-6221-4bab-b9c6-0ed3e07047a4"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:45.723304 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04a8c7d8-2064-4384-a4bd-e29d9466242e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:45.723912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04a8c7d8-2064-4384-a4bd-e29d9466242e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:45.724671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5c9cea15-471a-4eb5-9d8e-9e677bd0a9b9 req-572d9c6c-612c-44f0-a144-7c19ebd909a5 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.725113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5c9cea15-471a-4eb5-9d8e-9e677bd0a9b9 req-572d9c6c-612c-44f0-a144-7c19ebd909a5 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.730802 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04a8c7d8-2064-4384-a4bd-e29d9466242e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.731259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04a8c7d8-2064-4384-a4bd-e29d9466242e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.732029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04a8c7d8-2064-4384-a4bd-e29d9466242e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.732467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04a8c7d8-2064-4384-a4bd-e29d9466242e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.736731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-5c9cea15-471a-4eb5-9d8e-9e677bd0a9b9 req-572d9c6c-612c-44f0-a144-7c19ebd909a5 service nova] Creating event network-vif-plugged:8854eb96-6221-4bab-b9c6-0ed3e07047a4 for instance c8e6512b-4f9a-4929-9cdf-099229ccd261 on hv-cinder-81514 May 26 12:51:45.741809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-5c9cea15-471a-4eb5-9d8e-9e677bd0a9b9 req-572d9c6c-612c-44f0-a144-7c19ebd909a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030056 May 26 12:51:45.742409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 263/494] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:45.897293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04a8c7d8-2064-4384-a4bd-e29d9466242e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:45.906151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04a8c7d8-2064-4384-a4bd-e29d9466242e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1445 microversion: 2.1 time: 0.186736 May 26 12:51:45.906761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 232/495] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:45 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1445 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:46.056313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f06b505-df80-435c-bb7c-052067ae0a16 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:46.057852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f06b505-df80-435c-bb7c-052067ae0a16 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:46.071731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f06b505-df80-435c-bb7c-052067ae0a16 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.073216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f06b505-df80-435c-bb7c-052067ae0a16 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:46.073780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f06b505-df80-435c-bb7c-052067ae0a16 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.074298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f06b505-df80-435c-bb7c-052067ae0a16 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:46.166916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f06b505-df80-435c-bb7c-052067ae0a16 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:46.175414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f06b505-df80-435c-bb7c-052067ae0a16 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1218 microversion: 2.1 time: 0.123382 May 26 12:51:46.175996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 264/496] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:46 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:46.507125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-f2aa1a38-8d47-4e3c-a25d-2315ba2e1739 req-51a0cb4a-3743-449c-96d6-64858508174a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e5b57b-24ad-473d-9c97-b337fbac6fdc", "tag": "fc34668d-8f02-4867-b0e0-992d7f4dad7d"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:46.540483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-f2aa1a38-8d47-4e3c-a25d-2315ba2e1739 req-51a0cb4a-3743-449c-96d6-64858508174a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.541289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-f2aa1a38-8d47-4e3c-a25d-2315ba2e1739 req-51a0cb4a-3743-449c-96d6-64858508174a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:46.554788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-f2aa1a38-8d47-4e3c-a25d-2315ba2e1739 req-51a0cb4a-3743-449c-96d6-64858508174a service nova] Creating event network-changed:fc34668d-8f02-4867-b0e0-992d7f4dad7d for instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc on hv-cinder-81514 May 26 12:51:46.564985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-f2aa1a38-8d47-4e3c-a25d-2315ba2e1739 req-51a0cb4a-3743-449c-96d6-64858508174a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065239 May 26 12:51:46.569067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 233/497] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:46.617188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33cecfba-70a0-460b-97d4-b52a444ebf68 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:46.618094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33cecfba-70a0-460b-97d4-b52a444ebf68 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:46.629706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33cecfba-70a0-460b-97d4-b52a444ebf68 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.630591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33cecfba-70a0-460b-97d4-b52a444ebf68 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:46.632031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33cecfba-70a0-460b-97d4-b52a444ebf68 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.632493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33cecfba-70a0-460b-97d4-b52a444ebf68 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:46.844038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33cecfba-70a0-460b-97d4-b52a444ebf68 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:46.853537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33cecfba-70a0-460b-97d4-b52a444ebf68 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.239685 May 26 12:51:46.855173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 265/498] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:46 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:47.196142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8cd8f3e-100f-46f9-9a23-27fd73d390c4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:47.198074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8cd8f3e-100f-46f9-9a23-27fd73d390c4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:47.205563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8cd8f3e-100f-46f9-9a23-27fd73d390c4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:47.206054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8cd8f3e-100f-46f9-9a23-27fd73d390c4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:47.206901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8cd8f3e-100f-46f9-9a23-27fd73d390c4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:47.207522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8cd8f3e-100f-46f9-9a23-27fd73d390c4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:47.322947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b8cd8f3e-100f-46f9-9a23-27fd73d390c4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:47.334341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8cd8f3e-100f-46f9-9a23-27fd73d390c4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1266 microversion: 2.1 time: 0.142487 May 26 12:51:47.335212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 234/499] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:47 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:47.871823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91a8a682-5eec-4e89-bec2-0d2995f83dd7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:47.872437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-91a8a682-5eec-4e89-bec2-0d2995f83dd7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:47.879385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91a8a682-5eec-4e89-bec2-0d2995f83dd7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:47.879835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91a8a682-5eec-4e89-bec2-0d2995f83dd7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:47.880609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91a8a682-5eec-4e89-bec2-0d2995f83dd7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:47.881051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91a8a682-5eec-4e89-bec2-0d2995f83dd7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:48.042417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-91a8a682-5eec-4e89-bec2-0d2995f83dd7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:48.050107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91a8a682-5eec-4e89-bec2-0d2995f83dd7 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1366 microversion: 2.1 time: 0.182555 May 26 12:51:48.050830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 266/500] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:47 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:48.351950 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a468be2c-b41d-41ed-8b3d-c46e55ae2fca tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:48.352580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a468be2c-b41d-41ed-8b3d-c46e55ae2fca tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:48.359951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a468be2c-b41d-41ed-8b3d-c46e55ae2fca tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:48.360413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a468be2c-b41d-41ed-8b3d-c46e55ae2fca tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:48.361191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a468be2c-b41d-41ed-8b3d-c46e55ae2fca tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:48.361633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a468be2c-b41d-41ed-8b3d-c46e55ae2fca tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:48.452035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a468be2c-b41d-41ed-8b3d-c46e55ae2fca tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:48.467804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-4b1e3eb3-0b00-454e-b981-d8038df146a6 req-6f5df224-3449-4ac1-84b3-9c542f27ff0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3a12be-8748-41ab-a6a4-17d666ea34d0", "tag": "e5d66805-9eb5-4134-a395-25cf61316cc2"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:48.468516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a468be2c-b41d-41ed-8b3d-c46e55ae2fca tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1266 microversion: 2.1 time: 0.120419 May 26 12:51:48.470601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 235/501] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:48 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:48.476163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4b1e3eb3-0b00-454e-b981-d8038df146a6 req-6f5df224-3449-4ac1-84b3-9c542f27ff0e service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:48.476650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4b1e3eb3-0b00-454e-b981-d8038df146a6 req-6f5df224-3449-4ac1-84b3-9c542f27ff0e service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:48.489350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-4b1e3eb3-0b00-454e-b981-d8038df146a6 req-6f5df224-3449-4ac1-84b3-9c542f27ff0e service nova] Creating event network-changed:e5d66805-9eb5-4134-a395-25cf61316cc2 for instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 on hv-cinder-81514 May 26 12:51:48.495065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-4b1e3eb3-0b00-454e-b981-d8038df146a6 req-6f5df224-3449-4ac1-84b3-9c542f27ff0e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031307 May 26 12:51:48.495846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 267/502] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:51:49.067065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4420af8a-81e7-4189-924a-b208024e2dbb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:49.067680 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4420af8a-81e7-4189-924a-b208024e2dbb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:49.075783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4420af8a-81e7-4189-924a-b208024e2dbb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.076224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4420af8a-81e7-4189-924a-b208024e2dbb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.077005 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4420af8a-81e7-4189-924a-b208024e2dbb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.077441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4420af8a-81e7-4189-924a-b208024e2dbb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.487489 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-07c53049-a671-4957-8568-7051de210e35 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:49.492296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-07c53049-a671-4957-8568-7051de210e35 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:49.497889 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07c53049-a671-4957-8568-7051de210e35 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.498805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07c53049-a671-4957-8568-7051de210e35 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.499815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07c53049-a671-4957-8568-7051de210e35 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.500389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07c53049-a671-4957-8568-7051de210e35 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.573643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4420af8a-81e7-4189-924a-b208024e2dbb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:49.584158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4420af8a-81e7-4189-924a-b208024e2dbb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1556 microversion: 2.1 time: 0.520919 May 26 12:51:49.588657 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 236/503] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:49 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1556 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:49.589763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07c53049-a671-4957-8568-7051de210e35 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:49.610825 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6b46c87c-3bd1-49bd-8c5b-a392cb75ec76 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:49.612898 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6b46c87c-3bd1-49bd-8c5b-a392cb75ec76 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:49.618368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-07c53049-a671-4957-8568-7051de210e35 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1284 microversion: 2.1 time: 0.136283 May 26 12:51:49.619422 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 268/504] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:49 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:49.620558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b46c87c-3bd1-49bd-8c5b-a392cb75ec76 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.623036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b46c87c-3bd1-49bd-8c5b-a392cb75ec76 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.624389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b46c87c-3bd1-49bd-8c5b-a392cb75ec76 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.626162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b46c87c-3bd1-49bd-8c5b-a392cb75ec76 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.650960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:49.773037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cfaa6aa1-e91c-4679-bb3c-fedd4a4805f5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1099913049"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:49.773564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cfaa6aa1-e91c-4679-bb3c-fedd4a4805f5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:49.780239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfaa6aa1-e91c-4679-bb3c-fedd4a4805f5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.780691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfaa6aa1-e91c-4679-bb3c-fedd4a4805f5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.781470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfaa6aa1-e91c-4679-bb3c-fedd4a4805f5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.781903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfaa6aa1-e91c-4679-bb3c-fedd4a4805f5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.808787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6b46c87c-3bd1-49bd-8c5b-a392cb75ec76 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205408 May 26 12:51:49.809819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 237/505] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 26 12:51:49 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:50.198799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.network.security_group_api [None req-cfaa6aa1-e91c-4679-bb3c-fedd4a4805f5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Adding security group 2f549eab-58aa-4d73-ade4-7f0c29aa5d95 to port fc34668d-8f02-4867-b0e0-992d7f4dad7d May 26 12:51:50.641672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f8aa331-7d06-49cb-acf2-0de5564b5187 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:50.643433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f8aa331-7d06-49cb-acf2-0de5564b5187 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:50.651023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f8aa331-7d06-49cb-acf2-0de5564b5187 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.651484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f8aa331-7d06-49cb-acf2-0de5564b5187 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.652271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f8aa331-7d06-49cb-acf2-0de5564b5187 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.652713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f8aa331-7d06-49cb-acf2-0de5564b5187 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.718021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f8aa331-7d06-49cb-acf2-0de5564b5187 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:50.725863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f8aa331-7d06-49cb-acf2-0de5564b5187 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1272 microversion: 2.1 time: 0.093462 May 26 12:51:50.726445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 238/506] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:50 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:51.527083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cfaa6aa1-e91c-4679-bb3c-fedd4a4805f5 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "POST /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/action" status: 202 len: 0 microversion: 2.1 time: 1.757307 May 26 12:51:51.533430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 269/507] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:51:49 2022] POST /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/action => generated 0 bytes in 1765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:51:51.541298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b0724324-d0b3-42de-88d0-5c4d0ab7f09a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:51.541923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b0724324-d0b3-42de-88d0-5c4d0ab7f09a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:51.548409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-8cd5241f-de4d-4cbf-82dc-5adc5e521d74 req-3de4488a-0f89-45a4-b43c-845ca3937629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e5b57b-24ad-473d-9c97-b337fbac6fdc", "tag": "fc34668d-8f02-4867-b0e0-992d7f4dad7d"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:51.561759 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0724324-d0b3-42de-88d0-5c4d0ab7f09a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.562212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0724324-d0b3-42de-88d0-5c4d0ab7f09a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.571273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0724324-d0b3-42de-88d0-5c4d0ab7f09a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.575737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8cd5241f-de4d-4cbf-82dc-5adc5e521d74 req-3de4488a-0f89-45a4-b43c-845ca3937629 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.576596 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0724324-d0b3-42de-88d0-5c4d0ab7f09a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.581661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8cd5241f-de4d-4cbf-82dc-5adc5e521d74 req-3de4488a-0f89-45a4-b43c-845ca3937629 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.595356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-8cd5241f-de4d-4cbf-82dc-5adc5e521d74 req-3de4488a-0f89-45a4-b43c-845ca3937629 service nova] Creating event network-changed:fc34668d-8f02-4867-b0e0-992d7f4dad7d for instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc on hv-cinder-81514 May 26 12:51:51.600872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-8cd5241f-de4d-4cbf-82dc-5adc5e521d74 req-3de4488a-0f89-45a4-b43c-845ca3937629 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063736 May 26 12:51:51.602188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 270/508] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:51.744319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce0a616e-a29b-4905-9cc6-249c45cfc1a0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:51.745561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce0a616e-a29b-4905-9cc6-249c45cfc1a0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:51.752103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce0a616e-a29b-4905-9cc6-249c45cfc1a0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.752852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce0a616e-a29b-4905-9cc6-249c45cfc1a0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.753846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce0a616e-a29b-4905-9cc6-249c45cfc1a0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.754511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce0a616e-a29b-4905-9cc6-249c45cfc1a0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.891970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b0724324-d0b3-42de-88d0-5c4d0ab7f09a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:51.905726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b0724324-d0b3-42de-88d0-5c4d0ab7f09a tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1761 microversion: 2.1 time: 0.371575 May 26 12:51:51.906896 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 239/509] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:51 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1761 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:52.089323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ce0a616e-a29b-4905-9cc6-249c45cfc1a0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:52.099187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce0a616e-a29b-4905-9cc6-249c45cfc1a0 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.359431 May 26 12:51:52.102498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 271/510] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:51 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:53.116590 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9174b8ba-c395-4f13-b512-d6aed586f5d8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:53.117199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9174b8ba-c395-4f13-b512-d6aed586f5d8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:53.124241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9174b8ba-c395-4f13-b512-d6aed586f5d8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:53.124696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9174b8ba-c395-4f13-b512-d6aed586f5d8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:53.125519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9174b8ba-c395-4f13-b512-d6aed586f5d8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:53.126653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9174b8ba-c395-4f13-b512-d6aed586f5d8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:53.283806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9174b8ba-c395-4f13-b512-d6aed586f5d8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:53.292526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9174b8ba-c395-4f13-b512-d6aed586f5d8 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.180104 May 26 12:51:53.298711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 240/511] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:53 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:53.623725 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-6b120d1b-06e5-443c-a0b1-d289592c3475 req-67350014-78a2-4574-8e80-381b41a9e558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e6512b-4f9a-4929-9cdf-099229ccd261", "tag": "8854eb96-6221-4bab-b9c6-0ed3e07047a4"}, {"name": "network-changed", "server_uuid": "5ca1f0c1-afbd-4e90-8c37-77e0669422a7", "tag": "c31e989c-3a83-49b7-b668-534f7e1f731a"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:53.632941 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6b120d1b-06e5-443c-a0b1-d289592c3475 req-67350014-78a2-4574-8e80-381b41a9e558 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:53.633471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6b120d1b-06e5-443c-a0b1-d289592c3475 req-67350014-78a2-4574-8e80-381b41a9e558 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:53.646573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-6b120d1b-06e5-443c-a0b1-d289592c3475 req-67350014-78a2-4574-8e80-381b41a9e558 service nova] Creating event network-changed:8854eb96-6221-4bab-b9c6-0ed3e07047a4 for instance c8e6512b-4f9a-4929-9cdf-099229ccd261 on hv-cinder-81514 May 26 12:51:53.647083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-6b120d1b-06e5-443c-a0b1-d289592c3475 req-67350014-78a2-4574-8e80-381b41a9e558 service nova] Creating event network-changed:c31e989c-3a83-49b7-b668-534f7e1f731a for instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 on hv-cinder-81514 May 26 12:51:53.654377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-6b120d1b-06e5-443c-a0b1-d289592c3475 req-67350014-78a2-4574-8e80-381b41a9e558 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034345 May 26 12:51:53.654984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 272/512] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:54.310090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4a2b6d7-dd09-4689-b528-ed39d5a10292 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:54.310743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a4a2b6d7-dd09-4689-b528-ed39d5a10292 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:54.317369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4a2b6d7-dd09-4689-b528-ed39d5a10292 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:54.317814 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4a2b6d7-dd09-4689-b528-ed39d5a10292 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:54.318589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4a2b6d7-dd09-4689-b528-ed39d5a10292 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:54.319025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4a2b6d7-dd09-4689-b528-ed39d5a10292 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:54.451554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a4a2b6d7-dd09-4689-b528-ed39d5a10292 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:54.458774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4a2b6d7-dd09-4689-b528-ed39d5a10292 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.153227 May 26 12:51:54.459340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 241/513] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:54 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:55.473627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:55.474412 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:55.478959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef9148f5-7fcd-4f6d-a086-e4ff3e28ec0b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:55.479663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef9148f5-7fcd-4f6d-a086-e4ff3e28ec0b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:55.485789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef9148f5-7fcd-4f6d-a086-e4ff3e28ec0b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.490221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef9148f5-7fcd-4f6d-a086-e4ff3e28ec0b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.490221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef9148f5-7fcd-4f6d-a086-e4ff3e28ec0b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.490221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef9148f5-7fcd-4f6d-a086-e4ff3e28ec0b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.621243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef9148f5-7fcd-4f6d-a086-e4ff3e28ec0b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:55.628714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef9148f5-7fcd-4f6d-a086-e4ff3e28ec0b tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.156469 May 26 12:51:55.629282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 273/514] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:55 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:56.645856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-28a3bb1a-c623-4a78-a8de-782e361bdd14 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:56.646505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-28a3bb1a-c623-4a78-a8de-782e361bdd14 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:56.648410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:56.656929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28a3bb1a-c623-4a78-a8de-782e361bdd14 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.657383 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28a3bb1a-c623-4a78-a8de-782e361bdd14 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.658161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28a3bb1a-c623-4a78-a8de-782e361bdd14 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.658661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28a3bb1a-c623-4a78-a8de-782e361bdd14 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.793675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-28a3bb1a-c623-4a78-a8de-782e361bdd14 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:56.801109 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-28a3bb1a-c623-4a78-a8de-782e361bdd14 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.159091 May 26 12:51:56.801956 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 242/515] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:56 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:57.818605 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2235ad41-e6cb-4ef4-903d-a29fedeaf8d4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:57.819339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2235ad41-e6cb-4ef4-903d-a29fedeaf8d4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:57.826392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2235ad41-e6cb-4ef4-903d-a29fedeaf8d4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.826874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2235ad41-e6cb-4ef4-903d-a29fedeaf8d4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.827652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2235ad41-e6cb-4ef4-903d-a29fedeaf8d4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.828088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2235ad41-e6cb-4ef4-903d-a29fedeaf8d4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.955286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2235ad41-e6cb-4ef4-903d-a29fedeaf8d4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:57.962554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2235ad41-e6cb-4ef4-903d-a29fedeaf8d4 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.147924 May 26 12:51:57.963330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 274/516] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:57 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:58.979589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb52b698-af52-4618-84b8-4c288a37ad11 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:58.980217 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb52b698-af52-4618-84b8-4c288a37ad11 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:58.986871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb52b698-af52-4618-84b8-4c288a37ad11 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.987316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb52b698-af52-4618-84b8-4c288a37ad11 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:58.988072 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb52b698-af52-4618-84b8-4c288a37ad11 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.988508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb52b698-af52-4618-84b8-4c288a37ad11 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:59.121367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eb52b698-af52-4618-84b8-4c288a37ad11 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:59.129041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb52b698-af52-4618-84b8-4c288a37ad11 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.153439 May 26 12:51:59.129605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 243/517] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:51:58 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:00.091593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-57f740dc-c836-4442-a0b6-d24dc9cb8dcf req-8998a60d-44bd-4244-b037-de5e2dc3d1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca1f0c1-afbd-4e90-8c37-77e0669422a7", "name": "network-vif-plugged", "status": "completed", "tag": "c31e989c-3a83-49b7-b668-534f7e1f731a"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:00.099759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-57f740dc-c836-4442-a0b6-d24dc9cb8dcf req-8998a60d-44bd-4244-b037-de5e2dc3d1a5 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:00.100206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-57f740dc-c836-4442-a0b6-d24dc9cb8dcf req-8998a60d-44bd-4244-b037-de5e2dc3d1a5 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:00.111309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-57f740dc-c836-4442-a0b6-d24dc9cb8dcf req-8998a60d-44bd-4244-b037-de5e2dc3d1a5 service nova] Creating event network-vif-plugged:c31e989c-3a83-49b7-b668-534f7e1f731a for instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 on hv-cinder-81514 May 26 12:52:00.116206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-57f740dc-c836-4442-a0b6-d24dc9cb8dcf req-8998a60d-44bd-4244-b037-de5e2dc3d1a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029110 May 26 12:52:00.116788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 275/518] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:00.147045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-47bbffeb-6550-4c09-9e35-87fd032daa59 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:00.147689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-47bbffeb-6550-4c09-9e35-87fd032daa59 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:00.155087 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47bbffeb-6550-4c09-9e35-87fd032daa59 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:00.155656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47bbffeb-6550-4c09-9e35-87fd032daa59 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:00.156424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47bbffeb-6550-4c09-9e35-87fd032daa59 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:00.156866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47bbffeb-6550-4c09-9e35-87fd032daa59 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:00.289451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-47bbffeb-6550-4c09-9e35-87fd032daa59 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:00.297007 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-47bbffeb-6550-4c09-9e35-87fd032daa59 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.154111 May 26 12:52:00.297579 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 244/519] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:00 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:01.314316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bef7b1ac-707f-4f80-9e5d-77d32ffea6cf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:01.315043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bef7b1ac-707f-4f80-9e5d-77d32ffea6cf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:01.321251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bef7b1ac-707f-4f80-9e5d-77d32ffea6cf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.321756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bef7b1ac-707f-4f80-9e5d-77d32ffea6cf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.322502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bef7b1ac-707f-4f80-9e5d-77d32ffea6cf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.322965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bef7b1ac-707f-4f80-9e5d-77d32ffea6cf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.467010 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bef7b1ac-707f-4f80-9e5d-77d32ffea6cf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:01.474591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bef7b1ac-707f-4f80-9e5d-77d32ffea6cf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.164900 May 26 12:52:01.475155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 276/520] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:01 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:02.492342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75b1428c-ad00-4714-a9db-b67becc94317 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:02.492962 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75b1428c-ad00-4714-a9db-b67becc94317 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:02.500225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75b1428c-ad00-4714-a9db-b67becc94317 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.500685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75b1428c-ad00-4714-a9db-b67becc94317 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.501458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75b1428c-ad00-4714-a9db-b67becc94317 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.501900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75b1428c-ad00-4714-a9db-b67becc94317 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.644090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75b1428c-ad00-4714-a9db-b67becc94317 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:02.644090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75b1428c-ad00-4714-a9db-b67becc94317 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1314 microversion: 2.1 time: 0.155020 May 26 12:52:02.644090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 245/521] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:02 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:03.661053 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-729fb7d0-b44d-450d-984e-9776b8d9501a tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:03.661654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-729fb7d0-b44d-450d-984e-9776b8d9501a tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:03.668256 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-729fb7d0-b44d-450d-984e-9776b8d9501a tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.668641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-729fb7d0-b44d-450d-984e-9776b8d9501a tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:03.669488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-729fb7d0-b44d-450d-984e-9776b8d9501a tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.669922 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-729fb7d0-b44d-450d-984e-9776b8d9501a tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:03.799193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-729fb7d0-b44d-450d-984e-9776b8d9501a tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:03.807113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-729fb7d0-b44d-450d-984e-9776b8d9501a tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1498 microversion: 2.1 time: 0.149978 May 26 12:52:03.807675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 277/522] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:03 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:04.776134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19e686be-15b9-4c67-bdbf-93251c7d85bf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:04.776636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19e686be-15b9-4c67-bdbf-93251c7d85bf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:04.783186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19e686be-15b9-4c67-bdbf-93251c7d85bf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:04.783643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19e686be-15b9-4c67-bdbf-93251c7d85bf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.784432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19e686be-15b9-4c67-bdbf-93251c7d85bf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:04.784873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19e686be-15b9-4c67-bdbf-93251c7d85bf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.809796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19e686be-15b9-4c67-bdbf-93251c7d85bf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:52:05.060383 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19e686be-15b9-4c67-bdbf-93251c7d85bf tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 204 len: 0 microversion: 2.1 time: 0.288250 May 26 12:52:05.060897 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 246/523] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:52:04 2022] DELETE /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:52:05.069279 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-70599b73-fe37-4b96-8028-4715fb0d1c09 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:05.071315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-70599b73-fe37-4b96-8028-4715fb0d1c09 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:05.077733 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70599b73-fe37-4b96-8028-4715fb0d1c09 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:05.078180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70599b73-fe37-4b96-8028-4715fb0d1c09 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:05.078965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70599b73-fe37-4b96-8028-4715fb0d1c09 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:05.079398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70599b73-fe37-4b96-8028-4715fb0d1c09 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:05.444235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-70599b73-fe37-4b96-8028-4715fb0d1c09 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:05.447890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:05.452303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-70599b73-fe37-4b96-8028-4715fb0d1c09 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1504 microversion: 2.1 time: 0.387079 May 26 12:52:05.452880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 278/524] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:05 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:06.469739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-22e033ec-09ee-4ac9-85d4-9f94fad8293c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:06.470430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-22e033ec-09ee-4ac9-85d4-9f94fad8293c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:06.476939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22e033ec-09ee-4ac9-85d4-9f94fad8293c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:06.477388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22e033ec-09ee-4ac9-85d4-9f94fad8293c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:06.478145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22e033ec-09ee-4ac9-85d4-9f94fad8293c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:06.478649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22e033ec-09ee-4ac9-85d4-9f94fad8293c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:06.607134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22e033ec-09ee-4ac9-85d4-9f94fad8293c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:06.614427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-22e033ec-09ee-4ac9-85d4-9f94fad8293c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1504 microversion: 2.1 time: 0.148913 May 26 12:52:06.615018 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 247/525] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:06 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:07.631843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-959618cf-7531-4ae1-9da9-de8e6c7c891c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:07.632456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-959618cf-7531-4ae1-9da9-de8e6c7c891c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:07.640526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-959618cf-7531-4ae1-9da9-de8e6c7c891c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:07.640975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-959618cf-7531-4ae1-9da9-de8e6c7c891c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:07.641737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-959618cf-7531-4ae1-9da9-de8e6c7c891c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:07.642172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-959618cf-7531-4ae1-9da9-de8e6c7c891c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:07.855203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-3607e44b-98fa-44fd-ade8-10be5e78036a req-338a3168-0cab-4176-b229-a512ec4aa286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca1f0c1-afbd-4e90-8c37-77e0669422a7", "name": "network-vif-deleted", "tag": "c31e989c-3a83-49b7-b668-534f7e1f731a"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:07.863870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3607e44b-98fa-44fd-ade8-10be5e78036a req-338a3168-0cab-4176-b229-a512ec4aa286 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:07.864136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-959618cf-7531-4ae1-9da9-de8e6c7c891c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:07.870166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3607e44b-98fa-44fd-ade8-10be5e78036a req-338a3168-0cab-4176-b229-a512ec4aa286 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:07.872494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-959618cf-7531-4ae1-9da9-de8e6c7c891c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1504 microversion: 2.1 time: 0.244505 May 26 12:52:07.873067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 279/526] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:07 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:07.879229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-3607e44b-98fa-44fd-ade8-10be5e78036a req-338a3168-0cab-4176-b229-a512ec4aa286 service nova] Creating event network-vif-deleted:c31e989c-3a83-49b7-b668-534f7e1f731a for instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 on hv-cinder-81514 May 26 12:52:07.884113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-3607e44b-98fa-44fd-ade8-10be5e78036a req-338a3168-0cab-4176-b229-a512ec4aa286 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 May 26 12:52:07.885250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 248/527] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:52:08.889918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:08.890448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:08.896924 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:08.897370 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:08.898123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:08.898584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:08.929360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:08.929806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:08.930246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lazy-loading 'fault' on Instance uuid 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:52:08.972693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1933169d9a94afb9393d35f3a523c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c3cf0851794497aac57c9d2fbfc6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:08.979412 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6b20945-2c67-491d-b5c6-ee1979837b69 tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 200 len: 1304 microversion: 2.1 time: 0.093815 May 26 12:52:08.980006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 280/528] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:08 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:09.998202 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:09.998925 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] [instance: 5ca1f0c1-afbd-4e90-8c37-77e0669422a7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:10.005092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:10.005538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.006325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:10.006781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.019823 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] HTTP exception thrown: Instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 could not be found. May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Request method failure captured: May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 HTTP/1.1 May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3ept5uy7aM8DNCS_4Rue8bS8STkLDkWC8v5ai_rjRy-VqmcsomlGDooS1B1unnn3Y49giHSXHfO0d1KRIG_dU1y-Vaeo2qULJdz4kBpHb82S1ikABrLMz9CnStTI6hYO87a1a3YrRwNOWwDQlyFBV3RVwCM98LTFq561d0LOrP4ZXM May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: b2c3cf0851794497aac57c9d2fbfc6da May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesActionsTest-529444128 May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:52:10.021396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b2c3cf0851794497aac57c9d2fbfc6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b2c3cf0851794497aac57c9d2fbfc6da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b2c3cf0851794497aac57c9d2fbfc6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b2c3cf0851794497aac57c9d2fbfc6da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesActionsTest-529444128 May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: b2c3cf0851794497aac57c9d2fbfc6da May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesActionsTest-529444128 May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesActionsTest-529444128-project May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: b1933169d9a94afb9393d35f3a523c25 May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesActionsTest-529444128-project May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 could not be found. May 26 12:52:10.022941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '5ca1f0c1-afbd-4e90-8c37-77e0669422a7'} May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 could not be found. May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:52:10.023889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 could not be found. May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 could not be found. May 26 12:52:10.025423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:52:10.026902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] Returning 404 to user: Instance 5ca1f0c1-afbd-4e90-8c37-77e0669422a7 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:52:10.026902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77768a42-e1f6-49c8-bb26-c2879648279c tempest-VolumesActionsTest-529444128 tempest-VolumesActionsTest-529444128-project] 10.222.0.60 "GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7" status: 404 len: 111 microversion: 2.1 time: 0.030032 May 26 12:52:10.026902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 249/529] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:52:09 2022] GET /compute/v2.1/servers/5ca1f0c1-afbd-4e90-8c37-77e0669422a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:52:23.164018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-507733ce-2619-4197-94c7-36e97f01e60d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:23.165851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-507733ce-2619-4197-94c7-36e97f01e60d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:23.168928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:23.169623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=14 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:23.174833 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-507733ce-2619-4197-94c7-36e97f01e60d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:23.175290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-507733ce-2619-4197-94c7-36e97f01e60d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:23.176088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-507733ce-2619-4197-94c7-36e97f01e60d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:23.176532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-507733ce-2619-4197-94c7-36e97f01e60d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:23.204563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-507733ce-2619-4197-94c7-36e97f01e60d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/ips" status: 200 len: 152 microversion: 2.20 time: 0.044562 May 26 12:52:23.205154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 281/530] 10.222.0.60 () {60 vars in 1288 bytes} [Thu May 26 12:52:23 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:52:26.868782 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab7df32b-7f80-468c-90ff-83c02ac48a9a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:26.869347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab7df32b-7f80-468c-90ff-83c02ac48a9a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:26.871840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:26.872491 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:26.879794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab7df32b-7f80-468c-90ff-83c02ac48a9a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:26.880250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab7df32b-7f80-468c-90ff-83c02ac48a9a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:26.881022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab7df32b-7f80-468c-90ff-83c02ac48a9a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:26.881448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab7df32b-7f80-468c-90ff-83c02ac48a9a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:26.909576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-ab7df32b-7f80-468c-90ff-83c02ac48a9a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lazy-loading 'flavor' on Instance uuid 64085992-ecfa-4fbc-a713-04aff66c0042 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:52:27.589864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab7df32b-7f80-468c-90ff-83c02ac48a9a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/action" status: 202 len: 0 microversion: 2.20 time: 0.725594 May 26 12:52:27.593952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 250/531] 10.222.0.60 () {62 vars in 1318 bytes} [Thu May 26 12:52:26 2022] POST /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:52:27.599491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:27.600186 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:27.609024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:27.609836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:27.610657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:27.611105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:27.754822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:27.764100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:27.765740 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:27.767380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e9322fb-093f-435d-9379-13dcc209e291 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.172067 May 26 12:52:27.767941 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 282/532] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:27 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:28.787971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:28.789608 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:28.797545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:28.798022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:28.798840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:28.799275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:28.938075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:28.948155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:28.949791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:28.951459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3434938a-f530-43eb-af65-1599d6b15a62 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.168532 May 26 12:52:28.963507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 251/533] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:28 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:29.970926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:29.972017 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:29.980193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:29.980658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:29.981763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:29.982427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:30.142195 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:30.152070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:30.153939 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:30.155600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d038e9dd-4fee-41c7-ac25-408fa2caa3bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.188755 May 26 12:52:30.166718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 283/534] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:29 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:31.173298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:31.173932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:31.180996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:31.181457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:31.182287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:31.182764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:31.326786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:31.339064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:31.340733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:31.341928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-61127148-beae-4adb-9fc7-3e9b2170b153 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.172525 May 26 12:52:31.342473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 252/535] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:31 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:32.361458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:32.362290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:32.369480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:32.369938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:32.370758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:32.371204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:32.524632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:32.532611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:32.534178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:32.535304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b26286c-a8c9-44a9-a461-bdf5a71592fd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.177881 May 26 12:52:32.535870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 284/536] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:32 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:33.553198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:33.553952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:33.560475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:33.561006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:33.561797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:33.562230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:33.815842 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:33.824558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:33.826079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:33.827279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd9548d9-0399-4e6e-9a86-f108b1bd6a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.278018 May 26 12:52:33.827836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 253/537] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:33 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:34.846189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:34.846842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:34.853914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:34.854469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:34.855280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:34.855726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:34.981955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:34.989990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:34.992068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:34.993223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d3a80d4a-9a47-461f-9cd0-62cc645dd629 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.150885 May 26 12:52:34.993782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 285/538] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:34 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:36.011945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:36.013196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:36.019143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:36.019589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:36.020349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:36.020787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:36.156553 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:36.164801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:36.166323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:36.167530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b6482423-3c84-435e-87c6-22bc78d83e93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.159899 May 26 12:52:36.168090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 254/539] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:36 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:37.185552 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:37.186605 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:37.194783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:37.194783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:37.197562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:37.197562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:37.381945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:37.390107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:37.391632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:37.392773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f8da857-236a-4977-8e7e-66e9b2c24e0f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.211354 May 26 12:52:37.393321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 286/540] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:37 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:38.411587 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:38.412198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:38.419239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:38.419690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:38.420459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:38.420902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:38.550677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:38.560869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:38.562428 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:38.563665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-93540505-ff47-41fa-ae53-10552b7cbcd2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.156002 May 26 12:52:38.564209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 255/541] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:38 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:39.582418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:39.583056 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:39.589615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:39.590062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:39.590843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:39.591276 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:39.726019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:39.736021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:39.737581 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:39.738865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2f0a470-65e0-4efb-b2f0-d0793370cd4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.160290 May 26 12:52:39.741865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 287/542] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:39 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:40.762391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:40.763032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:40.769502 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:40.769962 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:40.770766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:40.771210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:40.904183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:40.912094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:40.913734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:40.914932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-182b7b93-ebd9-4b6d-8006-aeebb4098cfa tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1743 microversion: 2.20 time: 0.156669 May 26 12:52:40.915483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 256/543] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:40 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:52:41.933893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:41.934620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:41.941194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:41.941642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:41.942394 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:41.942869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:42.075119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:42.083088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:42.085312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:42.086481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f0c91300-a2b2-4aea-ae43-becaf3a3e63e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1743 microversion: 2.20 time: 0.156499 May 26 12:52:42.087072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 288/544] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:41 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:43.105954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:43.106488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:43.113052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:43.113506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:43.114279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:43.114752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:43.246232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:43.254311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:43.255951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:43.257080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9d3e27e-be6b-44f6-be62-b9b2cb83d671 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1743 microversion: 2.20 time: 0.155150 May 26 12:52:43.257624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 257/545] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:43 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:44.113976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-edad1280-4e1f-4953-8781-ba9159cf4d23 req-ac6aed3c-e5b5-4468-9af0-48eca5a66ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64085992-ecfa-4fbc-a713-04aff66c0042", "name": "network-vif-plugged", "status": "completed", "tag": "1099ed7a-51bc-411b-8a61-ea93c6361abe"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:44.123413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-edad1280-4e1f-4953-8781-ba9159cf4d23 req-ac6aed3c-e5b5-4468-9af0-48eca5a66ad3 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:44.123864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-edad1280-4e1f-4953-8781-ba9159cf4d23 req-ac6aed3c-e5b5-4468-9af0-48eca5a66ad3 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:44.135791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-edad1280-4e1f-4953-8781-ba9159cf4d23 req-ac6aed3c-e5b5-4468-9af0-48eca5a66ad3 service nova] Creating event network-vif-plugged:1099ed7a-51bc-411b-8a61-ea93c6361abe for instance 64085992-ecfa-4fbc-a713-04aff66c0042 on hv-cinder-81514 May 26 12:52:44.141110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-edad1280-4e1f-4953-8781-ba9159cf4d23 req-ac6aed3c-e5b5-4468-9af0-48eca5a66ad3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030964 May 26 12:52:44.142683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 289/546] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:44.275874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:44.276580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:44.283130 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:44.283602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:44.284370 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:44.284804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:44.417442 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:44.425360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:44.426999 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:44.428206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-042a433f-92ee-40dd-ae13-332d2b1b0e1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1743 microversion: 2.20 time: 0.156362 May 26 12:52:44.428766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 258/547] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:44 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:45.447224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:45.447926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:45.454637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:45.455085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:45.455872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:45.456419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:45.588170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:45.596001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:45.597525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:45.598702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-63ecbd0f-1d25-488a-84f0-8776d30dd546 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1743 microversion: 2.20 time: 0.156353 May 26 12:52:45.599858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 290/548] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:45 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:46.619940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:46.620554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:46.627027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:46.627480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:46.628247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:46.628692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:46.758334 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:46.766797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:46.768323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:46.769566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-84123318-3e79-48ec-a050-07607d6b0a0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1743 microversion: 2.20 time: 0.153477 May 26 12:52:46.770128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 259/549] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:46 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:47.788661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:47.789266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:47.795687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:47.796131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:47.796911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:47.797345 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:47.934343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:47.942231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:47.944446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:47.945646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-73069e56-b515-48bf-89bc-bb02a37200ca tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1743 microversion: 2.20 time: 0.161458 May 26 12:52:47.946182 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 291/550] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:47 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:48.965768 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:48.966376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:48.975657 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:48.976107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:48.976921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:48.977615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:49.141784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:49.152808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:49.155486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:49.156826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-948147f0-21cd-47d7-9e59-66712801c2b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.195312 May 26 12:52:49.157574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 260/551] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:48 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:52:50.177682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:50.179033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:50.188171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:50.188637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:50.189421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:50.190115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:50.381542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:50.394363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:50.397336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:50.398562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09bc5035-99b2-42c5-b920-9c77e3585f28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.225221 May 26 12:52:50.402971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 292/552] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:50 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:50.485462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-70b2f62b-e8f2-4fff-8995-46d85bb3db6a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbdfcf55-c9c6-4db5-8b59-a176ae3fbfc4"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:50.486615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-70b2f62b-e8f2-4fff-8995-46d85bb3db6a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:50.494165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70b2f62b-e8f2-4fff-8995-46d85bb3db6a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:50.494930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70b2f62b-e8f2-4fff-8995-46d85bb3db6a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:50.495896 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70b2f62b-e8f2-4fff-8995-46d85bb3db6a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:50.496335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70b2f62b-e8f2-4fff-8995-46d85bb3db6a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:51.276752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-70b2f62b-e8f2-4fff-8995-46d85bb3db6a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.035683 May 26 12:52:51.277753 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 261/553] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:52:50 2022] POST /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:51.417843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:51.435129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:51.435129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:51.435129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:51.435129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:51.435522 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:51.563226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:51.571754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:51.573249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:51.574399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8f9a1bcf-3ad1-4771-a7aa-0392078ee952 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.160485 May 26 12:52:51.574985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 293/554] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:51 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:52.593941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:52.594613 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:52.602730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:52.603531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:52.605177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:52.606983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:52.752790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:52.762118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:52.763819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:52.765320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1a4ee72-3d23-4cd0-8485-563b0f9151f2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.175776 May 26 12:52:52.765943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 262/555] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:52 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:53.787998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:53.788911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:53.796760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:53.797858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:53.799023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:53.799466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:53.953376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:53.962470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:53.964407 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:53.965769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d06f71d-8f46-4c67-a505-3472c4f412de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.184553 May 26 12:52:53.966551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 294/556] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:53 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:54.985113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:54.985728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:54.993305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:54.993765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:54.994555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:54.995000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:54.999001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:55.130865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:55.139630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:55.141138 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:55.142368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52bacece-fd8d-4aca-a4be-adf80318dab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.161119 May 26 12:52:55.142946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 263/557] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:54 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:56.164065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:56.164654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:56.175340 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:56.175979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:56.177189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:56.177631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:56.332283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:56.341083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:56.342807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:56.343979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ddfb7c8-ebca-4f76-aa19-5849ef740e68 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.184945 May 26 12:52:56.344525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 295/558] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:56 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:57.363039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:57.363683 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:57.366504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=29 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:57.372749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:57.373203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:57.374066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:57.374504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:57.536461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:57.546341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:57.547890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:57.549326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e362920-dc5e-4f32-8d92-719db28c81ea tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.190372 May 26 12:52:57.562875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 264/559] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:57 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:58.570352 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:58.575784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:58.577408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:58.577851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:58.578638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:58.579072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:58.581787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=85 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:58.730449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:58.738855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:58.740768 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:58.742064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6e9bacf-5cec-4e49-95b1-427d0c764d6e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.176543 May 26 12:52:58.742905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 296/560] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:58 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:59.761203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:59.762025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:59.768462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:59.768904 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:59.769665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:59.770098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:59.912152 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:59.922116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:59.924567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:59.925909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7236828-7a95-4766-a958-92d73d444e6d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.168675 May 26 12:52:59.926664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 265/561] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:52:59 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:59.953077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09c8421f-9cd9-45a2-ba1b-15a7a9eda311 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:59.954119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09c8421f-9cd9-45a2-ba1b-15a7a9eda311 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:59.961749 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09c8421f-9cd9-45a2-ba1b-15a7a9eda311 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:59.962207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09c8421f-9cd9-45a2-ba1b-15a7a9eda311 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:59.963036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09c8421f-9cd9-45a2-ba1b-15a7a9eda311 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:59.963486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09c8421f-9cd9-45a2-ba1b-15a7a9eda311 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:59.986738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-09c8421f-9cd9-45a2-ba1b-15a7a9eda311 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lazy-loading 'flavor' on Instance uuid 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:53:00.349430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09c8421f-9cd9-45a2-ba1b-15a7a9eda311 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/action" status: 200 len: 32 microversion: 2.1 time: 0.400050 May 26 12:53:00.351510 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 297/562] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:52:59 2022] POST /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:53:00.362667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05f65ae4-4cda-4487-86d0-db740d81e1d9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:00.363812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05f65ae4-4cda-4487-86d0-db740d81e1d9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:00.370540 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05f65ae4-4cda-4487-86d0-db740d81e1d9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:00.371016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05f65ae4-4cda-4487-86d0-db740d81e1d9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:00.371795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05f65ae4-4cda-4487-86d0-db740d81e1d9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:00.372236 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05f65ae4-4cda-4487-86d0-db740d81e1d9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:00.517155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05f65ae4-4cda-4487-86d0-db740d81e1d9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:00.528214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05f65ae4-4cda-4487-86d0-db740d81e1d9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.170436 May 26 12:53:00.528798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 266/563] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:00 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:00.946363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:00.947087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:00.949067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=35 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:00.954070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:00.958888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:00.958888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:00.958888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:01.143200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:01.151272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:01.152781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:01.153937 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6334374d-dba5-47a9-90a3-2c6865e45e73 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1738 microversion: 2.20 time: 0.212474 May 26 12:53:01.154503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 298/564] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:00 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:01.546379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aef18e43-28c0-45a5-a626-cc235ffefa01 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:01.547019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aef18e43-28c0-45a5-a626-cc235ffefa01 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:01.554777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aef18e43-28c0-45a5-a626-cc235ffefa01 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:01.555234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aef18e43-28c0-45a5-a626-cc235ffefa01 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:01.556003 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aef18e43-28c0-45a5-a626-cc235ffefa01 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:01.556653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aef18e43-28c0-45a5-a626-cc235ffefa01 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:01.770065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aef18e43-28c0-45a5-a626-cc235ffefa01 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:01.778440 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aef18e43-28c0-45a5-a626-cc235ffefa01 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.235815 May 26 12:53:01.779054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 267/565] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:01 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:02.172520 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:02.173116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:02.179720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:02.180166 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:02.180919 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:02.181376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:02.313152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:02.321647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:02.323190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:02.324336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c39b94c8-3c55-4c51-ae9b-8be9da7b4c21 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1720 microversion: 2.20 time: 0.155731 May 26 12:53:02.324888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 299/566] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:02 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:02.795848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cba10175-19d1-4543-a0db-e71f910650ec tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:02.796491 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cba10175-19d1-4543-a0db-e71f910650ec tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:02.803592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba10175-19d1-4543-a0db-e71f910650ec tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:02.804052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba10175-19d1-4543-a0db-e71f910650ec tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:02.804863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba10175-19d1-4543-a0db-e71f910650ec tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:02.805311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba10175-19d1-4543-a0db-e71f910650ec tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:02.937115 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cba10175-19d1-4543-a0db-e71f910650ec tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:02.945757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cba10175-19d1-4543-a0db-e71f910650ec tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.153852 May 26 12:53:02.946325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 268/567] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:02 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:03.343544 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:03.344152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:03.351798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:03.352458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:03.353236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:03.353971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:03.484376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:03.493035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:03.494558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:03.495707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c4de7004-c64e-4a90-b8a0-50eecb15015c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1720 microversion: 2.20 time: 0.156048 May 26 12:53:03.496260 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 300/568] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:03 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:03.963051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d8e1d6e-18e2-41ec-b022-c11d9de20faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:03.963663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d8e1d6e-18e2-41ec-b022-c11d9de20faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:03.970281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d8e1d6e-18e2-41ec-b022-c11d9de20faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:03.970805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d8e1d6e-18e2-41ec-b022-c11d9de20faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:03.971638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d8e1d6e-18e2-41ec-b022-c11d9de20faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:03.972080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d8e1d6e-18e2-41ec-b022-c11d9de20faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:04.109164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d8e1d6e-18e2-41ec-b022-c11d9de20faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:04.117814 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d8e1d6e-18e2-41ec-b022-c11d9de20faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.158639 May 26 12:53:04.118396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 269/569] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:03 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:04.188246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-29a1c5c7-27ea-421f-b6ea-cac6eb812359 req-afc45fb0-9ee2-4fc0-bf53-dff74a8ea4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64085992-ecfa-4fbc-a713-04aff66c0042", "name": "network-vif-unplugged", "status": "completed", "tag": "1099ed7a-51bc-411b-8a61-ea93c6361abe"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:04.196733 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-29a1c5c7-27ea-421f-b6ea-cac6eb812359 req-afc45fb0-9ee2-4fc0-bf53-dff74a8ea4ce service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:04.197186 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-29a1c5c7-27ea-421f-b6ea-cac6eb812359 req-afc45fb0-9ee2-4fc0-bf53-dff74a8ea4ce service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:04.208919 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-29a1c5c7-27ea-421f-b6ea-cac6eb812359 req-afc45fb0-9ee2-4fc0-bf53-dff74a8ea4ce service nova] Creating event network-vif-unplugged:1099ed7a-51bc-411b-8a61-ea93c6361abe for instance 64085992-ecfa-4fbc-a713-04aff66c0042 on hv-cinder-81514 May 26 12:53:04.216581 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-29a1c5c7-27ea-421f-b6ea-cac6eb812359 req-afc45fb0-9ee2-4fc0-bf53-dff74a8ea4ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029891 May 26 12:53:04.216581 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 301/570] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:53:04.515522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:04.516061 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:04.523168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:04.523626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:04.524405 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:04.524846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:04.658725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:04.666642 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:04.668167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:04.669323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d118ce0e-3e56-4b86-a80b-106f7639c604 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1723 microversion: 2.20 time: 0.157853 May 26 12:53:04.669885 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 270/571] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:04 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:04.688279 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4c45333f-3359-47f3-95a6-a8b2f379a58b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bdb215d-fcef-485a-aa5c-400018305935"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:04.689421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4c45333f-3359-47f3-95a6-a8b2f379a58b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:04.696615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c45333f-3359-47f3-95a6-a8b2f379a58b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:04.697067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c45333f-3359-47f3-95a6-a8b2f379a58b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:04.697831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c45333f-3359-47f3-95a6-a8b2f379a58b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:04.698269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c45333f-3359-47f3-95a6-a8b2f379a58b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:05.138301 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59c0b139-217e-444b-a2a8-ca1725941a93 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:05.139183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59c0b139-217e-444b-a2a8-ca1725941a93 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:05.145711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59c0b139-217e-444b-a2a8-ca1725941a93 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:05.146350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59c0b139-217e-444b-a2a8-ca1725941a93 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:05.147172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59c0b139-217e-444b-a2a8-ca1725941a93 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:05.147600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59c0b139-217e-444b-a2a8-ca1725941a93 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:05.303618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59c0b139-217e-444b-a2a8-ca1725941a93 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:05.311434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59c0b139-217e-444b-a2a8-ca1725941a93 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.178750 May 26 12:53:05.312002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 271/572] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:05 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:05.774304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4c45333f-3359-47f3-95a6-a8b2f379a58b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.090712 May 26 12:53:05.774965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 302/573] 10.222.0.60 () {62 vars in 1363 bytes} [Thu May 26 12:53:04 2022] POST /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments => generated 188 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:53:05.889142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5a6c2ca-3b7d-4aa1-96fd-b4315f6a1608 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:05.889714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5a6c2ca-3b7d-4aa1-96fd-b4315f6a1608 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:05.896212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a6c2ca-3b7d-4aa1-96fd-b4315f6a1608 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:05.896675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a6c2ca-3b7d-4aa1-96fd-b4315f6a1608 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:05.897532 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a6c2ca-3b7d-4aa1-96fd-b4315f6a1608 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:05.897976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a6c2ca-3b7d-4aa1-96fd-b4315f6a1608 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:06.214202 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5a6c2ca-3b7d-4aa1-96fd-b4315f6a1608 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/action" status: 202 len: 0 microversion: 2.20 time: 0.328904 May 26 12:53:06.214936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 272/574] 10.222.0.60 () {62 vars in 1318 bytes} [Thu May 26 12:53:05 2022] POST /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:53:06.222969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:06.223573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:06.229788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:06.230239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:06.231022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:06.231478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:06.328910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0232389-ebee-41af-9dbd-ec997ec24a59 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:06.333949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0232389-ebee-41af-9dbd-ec997ec24a59 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:06.337595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0232389-ebee-41af-9dbd-ec997ec24a59 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:06.338049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0232389-ebee-41af-9dbd-ec997ec24a59 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:06.338847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0232389-ebee-41af-9dbd-ec997ec24a59 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:06.339273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0232389-ebee-41af-9dbd-ec997ec24a59 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:06.373838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:06.384281 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:06.385851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:06.387229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9cf1a34b-6081-43ba-bafc-41543845ba9b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1749 microversion: 2.20 time: 0.168114 May 26 12:53:06.387793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 303/575] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:06 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:06.476603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d0232389-ebee-41af-9dbd-ec997ec24a59 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:06.484701 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0232389-ebee-41af-9dbd-ec997ec24a59 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.159858 May 26 12:53:06.485339 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 273/576] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:06 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:07.405191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:07.405825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:07.412671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:07.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:07.413883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:07.414319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:07.503040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-27372873-f768-441e-a8b6-c2ea928365c8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:07.504224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-27372873-f768-441e-a8b6-c2ea928365c8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:07.511227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27372873-f768-441e-a8b6-c2ea928365c8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:07.511683 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27372873-f768-441e-a8b6-c2ea928365c8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:07.512460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27372873-f768-441e-a8b6-c2ea928365c8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:07.512899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27372873-f768-441e-a8b6-c2ea928365c8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:07.561006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:07.570260 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:07.572603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:07.572995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab9e63f6-a133-466e-af2d-b508bd118834 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1749 microversion: 2.20 time: 0.171656 May 26 12:53:07.573564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 304/577] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:07 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:07.651541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27372873-f768-441e-a8b6-c2ea928365c8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:07.659727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-27372873-f768-441e-a8b6-c2ea928365c8 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.160526 May 26 12:53:07.660289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 274/578] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:07 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:08.591941 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:08.592515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:08.599615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:08.600069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:08.600837 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:08.601274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:08.677890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07d9fd5f-a491-4598-8bc0-80fbc3473265 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:08.678544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07d9fd5f-a491-4598-8bc0-80fbc3473265 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:08.684958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07d9fd5f-a491-4598-8bc0-80fbc3473265 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:08.685406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07d9fd5f-a491-4598-8bc0-80fbc3473265 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:08.686169 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07d9fd5f-a491-4598-8bc0-80fbc3473265 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:08.686632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07d9fd5f-a491-4598-8bc0-80fbc3473265 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:08.733176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:08.742113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:08.743651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:08.744815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e099575-d83f-4c55-bcb7-1392d9eb3db0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1751 microversion: 2.20 time: 0.156982 May 26 12:53:08.745386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 305/579] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:08 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:08.815196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07d9fd5f-a491-4598-8bc0-80fbc3473265 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:08.824437 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07d9fd5f-a491-4598-8bc0-80fbc3473265 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.151114 May 26 12:53:08.832280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 275/580] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:08 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:09.764916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:09.765530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:09.773228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:09.773678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:09.774441 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:09.774903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:09.841403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6eb8132-ef35-465a-94eb-b146b3086faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:09.841932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6eb8132-ef35-465a-94eb-b146b3086faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:09.848474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6eb8132-ef35-465a-94eb-b146b3086faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:09.848933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6eb8132-ef35-465a-94eb-b146b3086faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:09.850217 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6eb8132-ef35-465a-94eb-b146b3086faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:09.850797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6eb8132-ef35-465a-94eb-b146b3086faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:09.905564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:09.914861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:09.916350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:09.917529 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9c1ad5ae-48c7-4587-99c1-bd839abf2f7e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.156616 May 26 12:53:09.918082 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 306/581] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:09 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:09.985886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6eb8132-ef35-465a-94eb-b146b3086faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:09.993745 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6eb8132-ef35-465a-94eb-b146b3086faf tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.156439 May 26 12:53:09.994312 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 276/582] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:09 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:10.937561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:10.938201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:10.945833 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:10.946301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:10.947095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:10.947532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:11.011956 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1229e6d6-edc1-4a30-a8e3-b9dcf489e896 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:11.012575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1229e6d6-edc1-4a30-a8e3-b9dcf489e896 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:11.019347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1229e6d6-edc1-4a30-a8e3-b9dcf489e896 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:11.019806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1229e6d6-edc1-4a30-a8e3-b9dcf489e896 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:11.020591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1229e6d6-edc1-4a30-a8e3-b9dcf489e896 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:11.021147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1229e6d6-edc1-4a30-a8e3-b9dcf489e896 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:11.084404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:11.092679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:11.094176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:11.095400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6469521-ca93-4fdc-b543-16d9c7c4f5cb tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.161807 May 26 12:53:11.096318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 307/583] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:10 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:11.151091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1229e6d6-edc1-4a30-a8e3-b9dcf489e896 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:11.159115 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1229e6d6-edc1-4a30-a8e3-b9dcf489e896 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.151231 May 26 12:53:11.159697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 277/584] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:11 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:12.113358 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:12.113974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:12.120569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:12.121030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:12.121798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:12.122239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:12.177274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c4625cfc-b236-47c6-b9a7-ecd23f8d82f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:12.178178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c4625cfc-b236-47c6-b9a7-ecd23f8d82f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:12.204194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4625cfc-b236-47c6-b9a7-ecd23f8d82f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:12.204691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4625cfc-b236-47c6-b9a7-ecd23f8d82f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:12.205507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4625cfc-b236-47c6-b9a7-ecd23f8d82f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:12.205945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4625cfc-b236-47c6-b9a7-ecd23f8d82f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:12.290359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:12.292718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:12.300295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:12.303089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:12.304926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2ccce24d-da39-4da9-b0af-ce17ada1391b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.195486 May 26 12:53:12.305990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 308/585] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:12 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:12.362957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4625cfc-b236-47c6-b9a7-ecd23f8d82f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:12.369971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:12.373069 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c4625cfc-b236-47c6-b9a7-ecd23f8d82f1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.199853 May 26 12:53:12.373779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 278/586] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:12 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:13.323911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:13.324510 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:13.331176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:13.331619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:13.332371 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:13.332803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:13.392342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-24f31716-e55d-4cc7-8569-5602f149c853 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:13.393070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-24f31716-e55d-4cc7-8569-5602f149c853 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:13.400877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24f31716-e55d-4cc7-8569-5602f149c853 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:13.401619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24f31716-e55d-4cc7-8569-5602f149c853 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:13.402498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24f31716-e55d-4cc7-8569-5602f149c853 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:13.402980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24f31716-e55d-4cc7-8569-5602f149c853 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:13.494807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:13.503786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:13.507397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:13.507671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b8dd3301-34fb-4647-bbaa-9f3b2205e7ac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.188504 May 26 12:53:13.518788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 309/587] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:13 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:13.543851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-24f31716-e55d-4cc7-8569-5602f149c853 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:13.552056 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-24f31716-e55d-4cc7-8569-5602f149c853 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.164124 May 26 12:53:13.553257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 279/588] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:13 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:14.526488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:14.527175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:14.533667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:14.534047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:14.534847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:14.535277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:14.569341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-185d6dca-3370-41f5-833c-f2205c41334a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:14.569956 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-185d6dca-3370-41f5-833c-f2205c41334a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:14.576499 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-185d6dca-3370-41f5-833c-f2205c41334a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:14.576951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-185d6dca-3370-41f5-833c-f2205c41334a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:14.577726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-185d6dca-3370-41f5-833c-f2205c41334a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:14.578169 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-185d6dca-3370-41f5-833c-f2205c41334a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:14.686301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:14.695116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:14.696614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:14.697777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-538f9844-6440-4e96-b989-22347759df1d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.175147 May 26 12:53:14.698343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 310/589] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:14 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:14.734453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-185d6dca-3370-41f5-833c-f2205c41334a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:14.742509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-185d6dca-3370-41f5-833c-f2205c41334a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.177332 May 26 12:53:14.743103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 280/590] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:14 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:15.718433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:15.719077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:15.727751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:15.728177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:15.728985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:15.729475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:15.779458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3d3e2e00-ac2f-4e3e-b01b-983657751f06 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:15.781291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3d3e2e00-ac2f-4e3e-b01b-983657751f06 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:15.792680 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d3e2e00-ac2f-4e3e-b01b-983657751f06 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:15.793193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d3e2e00-ac2f-4e3e-b01b-983657751f06 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:15.794624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d3e2e00-ac2f-4e3e-b01b-983657751f06 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:15.795073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d3e2e00-ac2f-4e3e-b01b-983657751f06 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:15.888977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:15.903240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:15.912108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:15.913631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-891ad182-f458-4067-8a05-c9bd10fdd17c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.199703 May 26 12:53:15.918660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 311/591] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:15 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:15.957696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3d3e2e00-ac2f-4e3e-b01b-983657751f06 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:15.965684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3d3e2e00-ac2f-4e3e-b01b-983657751f06 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.209808 May 26 12:53:15.966174 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 281/592] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:15 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:16.933386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:16.933993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:16.940539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:16.940988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:16.941746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:16.943046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:16.983562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f4d77e28-889b-40e2-8326-41144d033d26 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:16.984623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f4d77e28-889b-40e2-8326-41144d033d26 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:16.992558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4d77e28-889b-40e2-8326-41144d033d26 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:16.997513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4d77e28-889b-40e2-8326-41144d033d26 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:16.997513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4d77e28-889b-40e2-8326-41144d033d26 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:16.997513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4d77e28-889b-40e2-8326-41144d033d26 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:17.090853 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:17.099707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:17.101455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:17.102811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd024506-ba5f-4f1f-a51e-20860846d3bc tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.173172 May 26 12:53:17.103758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 312/593] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:16 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:17.137124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f4d77e28-889b-40e2-8326-41144d033d26 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:17.145740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f4d77e28-889b-40e2-8326-41144d033d26 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.165726 May 26 12:53:17.146950 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 282/594] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:16 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:18.125507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:18.126920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:18.135305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:18.135759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:18.136538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:18.136976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:18.163959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5fdfeb93-c6ab-442b-9a21-192b6a3ef0bd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:18.165416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5fdfeb93-c6ab-442b-9a21-192b6a3ef0bd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:18.175754 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fdfeb93-c6ab-442b-9a21-192b6a3ef0bd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:18.176209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fdfeb93-c6ab-442b-9a21-192b6a3ef0bd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:18.177615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fdfeb93-c6ab-442b-9a21-192b6a3ef0bd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:18.178062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fdfeb93-c6ab-442b-9a21-192b6a3ef0bd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:18.292689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:18.304638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:18.306453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:18.307952 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2fc043e-8759-47ad-bc31-515b487f0166 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.186360 May 26 12:53:18.309209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 313/595] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:18 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:18.373084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5fdfeb93-c6ab-442b-9a21-192b6a3ef0bd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:18.382224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5fdfeb93-c6ab-442b-9a21-192b6a3ef0bd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.222689 May 26 12:53:18.383159 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 283/596] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:18 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:18.960493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-00479d8c-cd4d-4313-aa75-e8cbce070dfb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:18.961556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-00479d8c-cd4d-4313-aa75-e8cbce070dfb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:18.967881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00479d8c-cd4d-4313-aa75-e8cbce070dfb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:18.968327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00479d8c-cd4d-4313-aa75-e8cbce070dfb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:18.969084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00479d8c-cd4d-4313-aa75-e8cbce070dfb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:18.969517 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00479d8c-cd4d-4313-aa75-e8cbce070dfb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:19.224431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-00479d8c-cd4d-4313-aa75-e8cbce070dfb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "POST /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/action" status: 202 len: 0 microversion: 2.1 time: 0.266842 May 26 12:53:19.226410 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 314/597] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:53:18 2022] POST /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:19.234818 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-39cd8fe6-1d3a-47e9-87e9-6cd2e6cd4885 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:19.235599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-39cd8fe6-1d3a-47e9-87e9-6cd2e6cd4885 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:19.242964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39cd8fe6-1d3a-47e9-87e9-6cd2e6cd4885 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:19.243665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39cd8fe6-1d3a-47e9-87e9-6cd2e6cd4885 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:19.244748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39cd8fe6-1d3a-47e9-87e9-6cd2e6cd4885 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:19.245396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39cd8fe6-1d3a-47e9-87e9-6cd2e6cd4885 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:19.332100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:19.333551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:19.340044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:19.343624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:19.343624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:19.343624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:19.400790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-39cd8fe6-1d3a-47e9-87e9-6cd2e6cd4885 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:19.411637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-39cd8fe6-1d3a-47e9-87e9-6cd2e6cd4885 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.180100 May 26 12:53:19.414881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 284/598] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:19 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:19.422000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9917dc69-6944-4a3f-8d0d-7f4b4de5096c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:19.422000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9917dc69-6944-4a3f-8d0d-7f4b4de5096c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:19.427700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9917dc69-6944-4a3f-8d0d-7f4b4de5096c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:19.428266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9917dc69-6944-4a3f-8d0d-7f4b4de5096c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:19.430021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9917dc69-6944-4a3f-8d0d-7f4b4de5096c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:19.430021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9917dc69-6944-4a3f-8d0d-7f4b4de5096c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:19.501663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:19.522450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:19.524629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:19.526163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-424fdc79-a825-431e-83a0-52c3f03a0ec1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.198330 May 26 12:53:19.527230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 315/599] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:19 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:19.581317 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9917dc69-6944-4a3f-8d0d-7f4b4de5096c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:19.590977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9917dc69-6944-4a3f-8d0d-7f4b4de5096c tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.174510 May 26 12:53:19.591548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 285/600] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:19 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:20.433479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e611583-fb6f-4609-9b3b-6ecd5073e69e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:20.435129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1e611583-fb6f-4609-9b3b-6ecd5073e69e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:20.443511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e611583-fb6f-4609-9b3b-6ecd5073e69e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:20.444409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e611583-fb6f-4609-9b3b-6ecd5073e69e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:20.445392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e611583-fb6f-4609-9b3b-6ecd5073e69e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:20.445837 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e611583-fb6f-4609-9b3b-6ecd5073e69e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:20.544919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:20.545522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:20.553067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:20.553529 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:20.554313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:20.554869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:20.615170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1e611583-fb6f-4609-9b3b-6ecd5073e69e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:20.624368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1e611583-fb6f-4609-9b3b-6ecd5073e69e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.195860 May 26 12:53:20.624950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 316/601] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:20 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:20.629821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0641fb6-4af5-4650-8edd-9d134ca4a6f2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:20.630428 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0641fb6-4af5-4650-8edd-9d134ca4a6f2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:20.636857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0641fb6-4af5-4650-8edd-9d134ca4a6f2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:20.637287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0641fb6-4af5-4650-8edd-9d134ca4a6f2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:20.638047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0641fb6-4af5-4650-8edd-9d134ca4a6f2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:20.638481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0641fb6-4af5-4650-8edd-9d134ca4a6f2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:20.693621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:20.702789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:20.704318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:20.705506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f7c7b9c-5856-4925-90d6-481fd13ee015 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.164638 May 26 12:53:20.706056 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 286/602] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:20 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:20.777654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a0641fb6-4af5-4650-8edd-9d134ca4a6f2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:20.787289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a0641fb6-4af5-4650-8edd-9d134ca4a6f2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.160715 May 26 12:53:20.787871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 317/603] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:20 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:21.641254 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a1c2c1d7-3144-4795-bb38-678a5341f034 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:21.641923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a1c2c1d7-3144-4795-bb38-678a5341f034 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:21.648812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1c2c1d7-3144-4795-bb38-678a5341f034 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.649262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1c2c1d7-3144-4795-bb38-678a5341f034 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.650033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1c2c1d7-3144-4795-bb38-678a5341f034 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.650476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1c2c1d7-3144-4795-bb38-678a5341f034 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.725338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:21.725987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:21.732459 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.732910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.733675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.734116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.816486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a1c2c1d7-3144-4795-bb38-678a5341f034 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:21.824928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a1c2c1d7-3144-4795-bb38-678a5341f034 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.187596 May 26 12:53:21.825794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 287/604] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:21 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:21.830275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b5bbce3-0c1d-4f6c-bf3e-8b30148b1729 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:21.830900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b5bbce3-0c1d-4f6c-bf3e-8b30148b1729 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:21.838830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b5bbce3-0c1d-4f6c-bf3e-8b30148b1729 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.839615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b5bbce3-0c1d-4f6c-bf3e-8b30148b1729 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.840883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b5bbce3-0c1d-4f6c-bf3e-8b30148b1729 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.841398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b5bbce3-0c1d-4f6c-bf3e-8b30148b1729 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.900005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:21.908550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:21.910053 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:21.911865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f6db2493-ae58-4dc5-9aed-ec016c6b21ef tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.191183 May 26 12:53:21.912424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 318/605] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:21 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:21.999853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b5bbce3-0c1d-4f6c-bf3e-8b30148b1729 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:22.008055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b5bbce3-0c1d-4f6c-bf3e-8b30148b1729 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.181245 May 26 12:53:22.008615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 288/606] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:21 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:22.842015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7fb519f-236a-4d4d-b970-4ff167a2fd7f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:22.842688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7fb519f-236a-4d4d-b970-4ff167a2fd7f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:22.849388 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7fb519f-236a-4d4d-b970-4ff167a2fd7f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:22.849837 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7fb519f-236a-4d4d-b970-4ff167a2fd7f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:22.850669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7fb519f-236a-4d4d-b970-4ff167a2fd7f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:22.851113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7fb519f-236a-4d4d-b970-4ff167a2fd7f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:22.931430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:22.932043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:22.939700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:22.940163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:22.940938 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:22.941377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:22.997899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7fb519f-236a-4d4d-b970-4ff167a2fd7f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:23.006015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7fb519f-236a-4d4d-b970-4ff167a2fd7f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.167827 May 26 12:53:23.006611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 319/607] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:22 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:23.025436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-248c1a4b-589f-4d27-bfc7-e2f1282b35a5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:23.026085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-248c1a4b-589f-4d27-bfc7-e2f1282b35a5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:23.032287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-248c1a4b-589f-4d27-bfc7-e2f1282b35a5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:23.032547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-248c1a4b-589f-4d27-bfc7-e2f1282b35a5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:23.033400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-248c1a4b-589f-4d27-bfc7-e2f1282b35a5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:23.033850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-248c1a4b-589f-4d27-bfc7-e2f1282b35a5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:23.086270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:23.096647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:23.099539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:23.100744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-85df84db-7345-4248-9191-2e1e02b1bc5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.173633 May 26 12:53:23.108293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 289/608] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:22 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:23.175922 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-248c1a4b-589f-4d27-bfc7-e2f1282b35a5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:23.183924 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-248c1a4b-589f-4d27-bfc7-e2f1282b35a5 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.162187 May 26 12:53:23.184626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 320/609] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:23 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:24.024145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-00f1e343-a857-40b8-83ad-8f0192d3830d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:24.024780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-00f1e343-a857-40b8-83ad-8f0192d3830d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:24.031307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00f1e343-a857-40b8-83ad-8f0192d3830d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.031757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00f1e343-a857-40b8-83ad-8f0192d3830d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.032516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00f1e343-a857-40b8-83ad-8f0192d3830d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.032975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00f1e343-a857-40b8-83ad-8f0192d3830d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.119013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:24.119612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:24.125907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.126361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.127224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.127661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.200872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-00f1e343-a857-40b8-83ad-8f0192d3830d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:24.209958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-00f1e343-a857-40b8-83ad-8f0192d3830d tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.190227 May 26 12:53:24.220379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 290/610] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:24 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:24.229600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-486c8fa2-aaac-4429-8f3d-3b43e9a96723 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:24.229600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-486c8fa2-aaac-4429-8f3d-3b43e9a96723 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:24.234385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-486c8fa2-aaac-4429-8f3d-3b43e9a96723 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.235000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-486c8fa2-aaac-4429-8f3d-3b43e9a96723 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.235842 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-486c8fa2-aaac-4429-8f3d-3b43e9a96723 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.236294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-486c8fa2-aaac-4429-8f3d-3b43e9a96723 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.279849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:24.289590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:24.291127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:24.292311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b83fd5b1-00b2-491f-b91a-3136d73b3a12 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.177202 May 26 12:53:24.304905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 321/611] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:24 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:24.372511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-486c8fa2-aaac-4429-8f3d-3b43e9a96723 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:24.380536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-486c8fa2-aaac-4429-8f3d-3b43e9a96723 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.158823 May 26 12:53:24.381098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 291/612] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:24 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:25.228160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b745d56-0525-4b5e-944f-0510d33a5031 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:25.228776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b745d56-0525-4b5e-944f-0510d33a5031 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:25.235371 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b745d56-0525-4b5e-944f-0510d33a5031 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:25.235825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b745d56-0525-4b5e-944f-0510d33a5031 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:25.236591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b745d56-0525-4b5e-944f-0510d33a5031 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:25.237032 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b745d56-0525-4b5e-944f-0510d33a5031 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:25.311210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:25.311856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:25.318627 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:25.319083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:25.319864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:25.320303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:25.381341 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b745d56-0525-4b5e-944f-0510d33a5031 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:25.389780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b745d56-0525-4b5e-944f-0510d33a5031 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.165414 May 26 12:53:25.390766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 322/613] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:25 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:25.405301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c2cb137-8fee-4c40-a2bb-4107069a96a4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:25.405910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c2cb137-8fee-4c40-a2bb-4107069a96a4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:25.413409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c2cb137-8fee-4c40-a2bb-4107069a96a4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:25.413861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c2cb137-8fee-4c40-a2bb-4107069a96a4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:25.414664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c2cb137-8fee-4c40-a2bb-4107069a96a4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:25.415106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c2cb137-8fee-4c40-a2bb-4107069a96a4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:25.461261 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:25.469676 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:25.471257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:25.472430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f78ed10-4b71-4263-83ca-404dd2fd5082 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.165204 May 26 12:53:25.473546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 292/614] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:25 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:25.544791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c2cb137-8fee-4c40-a2bb-4107069a96a4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:25.553080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c2cb137-8fee-4c40-a2bb-4107069a96a4 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.151910 May 26 12:53:25.553645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 323/615] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:25 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:26.406991 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d2e2e3e8-6d18-4a67-87ff-facd035c795b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:26.407609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d2e2e3e8-6d18-4a67-87ff-facd035c795b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:26.414283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2e2e3e8-6d18-4a67-87ff-facd035c795b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:26.414767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2e2e3e8-6d18-4a67-87ff-facd035c795b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:26.415613 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2e2e3e8-6d18-4a67-87ff-facd035c795b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:26.416052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2e2e3e8-6d18-4a67-87ff-facd035c795b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:26.490384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:26.491388 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:26.497855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:26.498301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:26.499083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:26.499514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:26.516795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:26.557253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d2e2e3e8-6d18-4a67-87ff-facd035c795b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:26.565501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d2e2e3e8-6d18-4a67-87ff-facd035c795b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.162297 May 26 12:53:26.566078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 293/616] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:26 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:26.571259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7fc67686-7b0f-4db7-9512-338bcb9092d2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:26.571871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7fc67686-7b0f-4db7-9512-338bcb9092d2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:26.578820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc67686-7b0f-4db7-9512-338bcb9092d2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:26.579279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc67686-7b0f-4db7-9512-338bcb9092d2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:26.580064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc67686-7b0f-4db7-9512-338bcb9092d2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:26.580508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc67686-7b0f-4db7-9512-338bcb9092d2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:26.636187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:26.644977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:26.646481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:26.647756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97e90596-7757-4876-b1c1-214243d21f47 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.161237 May 26 12:53:26.648314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 324/617] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:26 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:26.715010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fc67686-7b0f-4db7-9512-338bcb9092d2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:26.723154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7fc67686-7b0f-4db7-9512-338bcb9092d2 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.155168 May 26 12:53:26.723835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 294/618] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:26 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:27.584301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-406672fc-ccd5-45a1-a65c-aab32040c730 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:27.584829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-406672fc-ccd5-45a1-a65c-aab32040c730 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:27.591470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-406672fc-ccd5-45a1-a65c-aab32040c730 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:27.591923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-406672fc-ccd5-45a1-a65c-aab32040c730 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:27.592687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-406672fc-ccd5-45a1-a65c-aab32040c730 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:27.593129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-406672fc-ccd5-45a1-a65c-aab32040c730 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:27.665948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:27.666571 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:27.668897 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=64 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:27.674040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:27.674040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:27.674862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:27.675315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:27.694888 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:27.740406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-406672fc-ccd5-45a1-a65c-aab32040c730 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:27.748675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-406672fc-ccd5-45a1-a65c-aab32040c730 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.168768 May 26 12:53:27.749252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 325/619] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:27 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:27.754380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6babf03b-23b7-4379-8843-aaf4720c8ec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:27.761347 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6babf03b-23b7-4379-8843-aaf4720c8ec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:27.761683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6babf03b-23b7-4379-8843-aaf4720c8ec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:27.761959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6babf03b-23b7-4379-8843-aaf4720c8ec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:27.762810 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6babf03b-23b7-4379-8843-aaf4720c8ec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:27.763252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6babf03b-23b7-4379-8843-aaf4720c8ec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:27.808385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:27.817624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:27.819286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:27.820454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9aeed445-a583-48de-a9d4-b3865e4573da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.158442 May 26 12:53:27.821016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 295/620] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:27 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:27.890970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6babf03b-23b7-4379-8843-aaf4720c8ec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:27.899693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6babf03b-23b7-4379-8843-aaf4720c8ec0 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.149484 May 26 12:53:27.900264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 326/621] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:27 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:28.766635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b2779137-4987-4373-9ca3-6282dab4407c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:28.767261 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b2779137-4987-4373-9ca3-6282dab4407c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:28.774350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2779137-4987-4373-9ca3-6282dab4407c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.774830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2779137-4987-4373-9ca3-6282dab4407c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.775588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2779137-4987-4373-9ca3-6282dab4407c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.776018 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2779137-4987-4373-9ca3-6282dab4407c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.839278 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:28.839872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:28.846050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.846509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.847366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.848018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.924418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b2779137-4987-4373-9ca3-6282dab4407c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:28.933283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b2779137-4987-4373-9ca3-6282dab4407c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.170407 May 26 12:53:28.934101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 296/622] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:28 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:28.938493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-08c60a26-577f-443f-8ea0-a76d215a661e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:28.939120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-08c60a26-577f-443f-8ea0-a76d215a661e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:28.945449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c60a26-577f-443f-8ea0-a76d215a661e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.945922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c60a26-577f-443f-8ea0-a76d215a661e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.946711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c60a26-577f-443f-8ea0-a76d215a661e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.947330 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c60a26-577f-443f-8ea0-a76d215a661e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.987212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:28.996062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:28.997577 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:28.998770 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23ccaed7-50db-4bd9-9e7c-8c3866bbff88 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.163387 May 26 12:53:28.999531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 327/623] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:28 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:29.076073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08c60a26-577f-443f-8ea0-a76d215a661e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:29.085089 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-08c60a26-577f-443f-8ea0-a76d215a661e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.150208 May 26 12:53:29.085656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 297/624] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:28 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:29.950457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf1c1fd6-894a-42bb-b5e4-31f538843ffc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:29.951129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf1c1fd6-894a-42bb-b5e4-31f538843ffc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:29.957687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fd6-894a-42bb-b5e4-31f538843ffc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:29.958134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fd6-894a-42bb-b5e4-31f538843ffc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:29.958944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fd6-894a-42bb-b5e4-31f538843ffc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:29.959379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fd6-894a-42bb-b5e4-31f538843ffc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.017300 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:30.017910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:30.024623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.025078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.025855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.026307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.100678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf1c1fd6-894a-42bb-b5e4-31f538843ffc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:30.108566 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf1c1fd6-894a-42bb-b5e4-31f538843ffc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.161930 May 26 12:53:30.109122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 328/625] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:29 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:30.114313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c97e4250-cea7-43cc-b434-e54ade31ef7d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:30.115044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c97e4250-cea7-43cc-b434-e54ade31ef7d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:30.121003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c97e4250-cea7-43cc-b434-e54ade31ef7d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.121462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c97e4250-cea7-43cc-b434-e54ade31ef7d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.122233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c97e4250-cea7-43cc-b434-e54ade31ef7d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.122702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c97e4250-cea7-43cc-b434-e54ade31ef7d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.161158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:30.169937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:30.171479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:30.172650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7bdc1283-7dcd-4e14-8848-556d6fbdc2e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.159352 May 26 12:53:30.173211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 298/626] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:30 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:30.254141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c97e4250-cea7-43cc-b434-e54ade31ef7d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:30.262676 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c97e4250-cea7-43cc-b434-e54ade31ef7d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.152530 May 26 12:53:30.263265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 329/627] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:30 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:31.126456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dafc5f7f-69d0-4967-be5c-d5a6bad860cf tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:31.127091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dafc5f7f-69d0-4967-be5c-d5a6bad860cf tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:31.134684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dafc5f7f-69d0-4967-be5c-d5a6bad860cf tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.135142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dafc5f7f-69d0-4967-be5c-d5a6bad860cf tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.135900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dafc5f7f-69d0-4967-be5c-d5a6bad860cf tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.136336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dafc5f7f-69d0-4967-be5c-d5a6bad860cf tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.192435 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:31.193851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:31.196348 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=64 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:31.201061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.201508 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.202332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.202796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.284454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dafc5f7f-69d0-4967-be5c-d5a6bad860cf tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.293751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dafc5f7f-69d0-4967-be5c-d5a6bad860cf tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.171129 May 26 12:53:31.296351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 299/628] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:31 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:31.298972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b040d1d-a74e-4129-a935-ba54a604a500 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:31.299583 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b040d1d-a74e-4129-a935-ba54a604a500 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:31.306256 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b040d1d-a74e-4129-a935-ba54a604a500 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.306757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b040d1d-a74e-4129-a935-ba54a604a500 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.307536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b040d1d-a74e-4129-a935-ba54a604a500 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.308000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b040d1d-a74e-4129-a935-ba54a604a500 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.340975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.349929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.351560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.352736 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1357688b-0659-4429-b993-617cab974d1b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.164823 May 26 12:53:31.353297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 330/629] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:31 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:31.436480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4b040d1d-a74e-4129-a935-ba54a604a500 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.444599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b040d1d-a74e-4129-a935-ba54a604a500 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.149220 May 26 12:53:31.445166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 300/630] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:31 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:32.311761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a30445ca-157d-464d-be48-fdc9d771e6eb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:32.313119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a30445ca-157d-464d-be48-fdc9d771e6eb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:32.319960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a30445ca-157d-464d-be48-fdc9d771e6eb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.320414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a30445ca-157d-464d-be48-fdc9d771e6eb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.321193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a30445ca-157d-464d-be48-fdc9d771e6eb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.321632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a30445ca-157d-464d-be48-fdc9d771e6eb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.371796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:32.372429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:32.384987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.385443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.386231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.386699 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.478886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a30445ca-157d-464d-be48-fdc9d771e6eb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:32.486949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a30445ca-157d-464d-be48-fdc9d771e6eb tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1753 microversion: 2.1 time: 0.178991 May 26 12:53:32.487598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 331/631] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:32 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:32.493249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f835eff7-45a9-4e79-aa5d-17b09aa2a87e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:32.493748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f835eff7-45a9-4e79-aa5d-17b09aa2a87e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:32.499752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f835eff7-45a9-4e79-aa5d-17b09aa2a87e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.500208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f835eff7-45a9-4e79-aa5d-17b09aa2a87e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.500977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f835eff7-45a9-4e79-aa5d-17b09aa2a87e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.501419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f835eff7-45a9-4e79-aa5d-17b09aa2a87e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.526568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:32.540276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:32.541720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:32.543774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1dfc0a67-0453-4e24-87a0-b3e92fd7131d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.175083 May 26 12:53:32.554891 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 301/632] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:32 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:32.647231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f835eff7-45a9-4e79-aa5d-17b09aa2a87e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:32.655289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f835eff7-45a9-4e79-aa5d-17b09aa2a87e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.165570 May 26 12:53:32.655991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 332/633] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:32 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:33.504821 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6500fdb5-36c8-4d61-844b-1ec639670512 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.505570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6500fdb5-36c8-4d61-844b-1ec639670512 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.512367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6500fdb5-36c8-4d61-844b-1ec639670512 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.512819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6500fdb5-36c8-4d61-844b-1ec639670512 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.513581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6500fdb5-36c8-4d61-844b-1ec639670512 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.514021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6500fdb5-36c8-4d61-844b-1ec639670512 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.587147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.587147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.587147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.587147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.587971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.587971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.664128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6500fdb5-36c8-4d61-844b-1ec639670512 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:33.666907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6500fdb5-36c8-4d61-844b-1ec639670512 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.166280 May 26 12:53:33.667809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 302/634] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:33 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:33.672274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-039879a2-e591-4fb8-acc9-e020cca8aa5f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.672884 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-039879a2-e591-4fb8-acc9-e020cca8aa5f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.679727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-039879a2-e591-4fb8-acc9-e020cca8aa5f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.680182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-039879a2-e591-4fb8-acc9-e020cca8aa5f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.680968 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-039879a2-e591-4fb8-acc9-e020cca8aa5f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.681406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-039879a2-e591-4fb8-acc9-e020cca8aa5f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.715289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:33.723834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:33.725375 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:33.726615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e4b02a37-9e36-4f94-bf82-6c16743906a5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.166758 May 26 12:53:33.727187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 333/635] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:33 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:33.817030 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-039879a2-e591-4fb8-acc9-e020cca8aa5f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:33.824918 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-039879a2-e591-4fb8-acc9-e020cca8aa5f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.156162 May 26 12:53:33.825488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 303/636] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:33 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:34.685378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-823bffc7-605a-4836-bccb-b63139803c35 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:34.685993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-823bffc7-605a-4836-bccb-b63139803c35 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:34.693021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-823bffc7-605a-4836-bccb-b63139803c35 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.693471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-823bffc7-605a-4836-bccb-b63139803c35 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.694237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-823bffc7-605a-4836-bccb-b63139803c35 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.694706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-823bffc7-605a-4836-bccb-b63139803c35 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.745215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:34.745917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:34.752484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.752936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.754211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.754702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.840722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-823bffc7-605a-4836-bccb-b63139803c35 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:34.849429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-823bffc7-605a-4836-bccb-b63139803c35 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.167756 May 26 12:53:34.849978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 334/637] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:34 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:34.854871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a7292593-9c6f-4468-8193-c2e2edaa2901 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:34.855466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a7292593-9c6f-4468-8193-c2e2edaa2901 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:34.861764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7292593-9c6f-4468-8193-c2e2edaa2901 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.862228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7292593-9c6f-4468-8193-c2e2edaa2901 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.863006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7292593-9c6f-4468-8193-c2e2edaa2901 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.863438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7292593-9c6f-4468-8193-c2e2edaa2901 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.886073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:34.896159 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:34.897918 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:34.899155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd62a9c1-4c48-486f-b08d-a490a577b127 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.157853 May 26 12:53:34.899733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 304/638] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:34 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:34.997743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7292593-9c6f-4468-8193-c2e2edaa2901 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:35.005687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a7292593-9c6f-4468-8193-c2e2edaa2901 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1736 microversion: 2.1 time: 0.154572 May 26 12:53:35.006247 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 335/639] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:34 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:35.867227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56cdbb8e-cc81-4f18-8512-6e90d394afaa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.867765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56cdbb8e-cc81-4f18-8512-6e90d394afaa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:35.874239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56cdbb8e-cc81-4f18-8512-6e90d394afaa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.874717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56cdbb8e-cc81-4f18-8512-6e90d394afaa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.875473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56cdbb8e-cc81-4f18-8512-6e90d394afaa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.875908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56cdbb8e-cc81-4f18-8512-6e90d394afaa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.922700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.923285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:35.931213 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.931664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.932440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.932874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.031269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56cdbb8e-cc81-4f18-8512-6e90d394afaa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:36.040285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56cdbb8e-cc81-4f18-8512-6e90d394afaa tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.176882 May 26 12:53:36.040870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 305/640] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:35 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:36.054232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aa5a0067-8c0d-4326-883c-ca83050810b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:36.054872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aa5a0067-8c0d-4326-883c-ca83050810b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:36.061098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa5a0067-8c0d-4326-883c-ca83050810b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:36.061552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa5a0067-8c0d-4326-883c-ca83050810b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.062328 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa5a0067-8c0d-4326-883c-ca83050810b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:36.062800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa5a0067-8c0d-4326-883c-ca83050810b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.071797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:36.080144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:36.081966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:36.083144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c258bc4e-ef8d-4190-a0e8-71eacd9bedd0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.164437 May 26 12:53:36.083697 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 336/641] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:35 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:36.189855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aa5a0067-8c0d-4326-883c-ca83050810b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:36.198064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aa5a0067-8c0d-4326-883c-ca83050810b6 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1716 microversion: 2.1 time: 0.156217 May 26 12:53:36.202574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 306/642] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:36 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:36.256112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:36.256907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:36.263222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:36.263678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.264458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:36.264899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.393324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec while it is in vm_state rescued May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Request method failure captured: May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments/cbdfcf55-c9c6-4db5-8b59-a176ae3fbfc4 HTTP/1.1 May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvtkij4vGeBs7o_ED6e20XDMM79LFEkKwE8zRDpvN-e3EokvsRt-JGUUN4Oo94FKBMSuwxb2TwC31iolTdyP5G4mlFFfHCkb5zEc8xpa6Jvr0JXGOIAg35z_iMaus7NIylOEpTQw4UMLS4Hqw6q9SWL-MOnMbMad1TU8wvSpoQUoY May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:53:36.395433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: e24e8e8d0b8042bfb7ee7881aa8a16c1 May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:53:36.397037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Cannot 'detach_volume' instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec while it is in vm_state rescued May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec', 'id': 'cbdfcf55-c9c6-4db5-8b59-a176ae3fbfc4'} May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:36.397946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec while it is in vm_state rescued May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec while it is in vm_state rescued May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:36.399585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Returning 409 to user: Cannot 'detach_volume' instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec while it is in vm_state rescued {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:36.400861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb997108-147d-4cf3-bd52-c4b221bb868e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments/cbdfcf55-c9c6-4db5-8b59-a176ae3fbfc4" status: 409 len: 152 microversion: 2.1 time: 0.144930 May 26 12:53:36.400861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 337/643] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 12:53:36 2022] DELETE /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments/cbdfcf55-c9c6-4db5-8b59-a176ae3fbfc4 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 12:53:36.405729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-033d84cf-cff4-4fea-a3fb-20d83236f3dd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:36.406267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-033d84cf-cff4-4fea-a3fb-20d83236f3dd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:36.413087 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-033d84cf-cff4-4fea-a3fb-20d83236f3dd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:36.413545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-033d84cf-cff4-4fea-a3fb-20d83236f3dd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.414327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-033d84cf-cff4-4fea-a3fb-20d83236f3dd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:36.414795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-033d84cf-cff4-4fea-a3fb-20d83236f3dd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.638455 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-033d84cf-cff4-4fea-a3fb-20d83236f3dd tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "POST /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/action" status: 202 len: 0 microversion: 2.1 time: 0.235946 May 26 12:53:36.639522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 307/644] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:53:36 2022] POST /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:36.648954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-27ea1f23-1953-4b12-8935-9ce4c6e8207b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:36.649926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-27ea1f23-1953-4b12-8935-9ce4c6e8207b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:36.658676 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27ea1f23-1953-4b12-8935-9ce4c6e8207b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:36.658676 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27ea1f23-1953-4b12-8935-9ce4c6e8207b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.658676 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27ea1f23-1953-4b12-8935-9ce4c6e8207b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:36.658676 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27ea1f23-1953-4b12-8935-9ce4c6e8207b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:36.788660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27ea1f23-1953-4b12-8935-9ce4c6e8207b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:36.796561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-27ea1f23-1953-4b12-8935-9ce4c6e8207b tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1724 microversion: 2.1 time: 0.152918 May 26 12:53:36.797125 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 338/645] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:36 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:37.058342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fde4e251-78f4-40ab-b212-9d69d43ba844 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:37.059012 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fde4e251-78f4-40ab-b212-9d69d43ba844 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:37.065427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fde4e251-78f4-40ab-b212-9d69d43ba844 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:37.066464 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fde4e251-78f4-40ab-b212-9d69d43ba844 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:37.067337 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fde4e251-78f4-40ab-b212-9d69d43ba844 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:37.067781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fde4e251-78f4-40ab-b212-9d69d43ba844 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:37.101074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:37.101679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:37.108303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:37.108756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:37.109527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:37.109962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:37.210893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fde4e251-78f4-40ab-b212-9d69d43ba844 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:37.218862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fde4e251-78f4-40ab-b212-9d69d43ba844 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.165315 May 26 12:53:37.219454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 308/646] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:37 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:37.242467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:37.250851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:37.252375 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:37.254265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f595186f-4889-4b45-b35e-7d50e91c5d79 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.157057 May 26 12:53:37.254844 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 339/647] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:37 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:37.814518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab2af4e9-ff99-4ed2-8d7b-e59b2ba2007a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:37.815191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab2af4e9-ff99-4ed2-8d7b-e59b2ba2007a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:37.821624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab2af4e9-ff99-4ed2-8d7b-e59b2ba2007a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:37.822076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab2af4e9-ff99-4ed2-8d7b-e59b2ba2007a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:37.822883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab2af4e9-ff99-4ed2-8d7b-e59b2ba2007a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:37.823320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab2af4e9-ff99-4ed2-8d7b-e59b2ba2007a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:37.963604 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ab2af4e9-ff99-4ed2-8d7b-e59b2ba2007a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:37.972311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab2af4e9-ff99-4ed2-8d7b-e59b2ba2007a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1724 microversion: 2.1 time: 0.161111 May 26 12:53:37.972941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 309/648] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:37 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:38.236022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b13a3833-5434-45e7-af08-cafdfc121049 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.236652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b13a3833-5434-45e7-af08-cafdfc121049 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.244380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b13a3833-5434-45e7-af08-cafdfc121049 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.244911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b13a3833-5434-45e7-af08-cafdfc121049 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.245849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b13a3833-5434-45e7-af08-cafdfc121049 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.246447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b13a3833-5434-45e7-af08-cafdfc121049 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.273638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.274338 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.284597 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.285055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.290996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.291465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.441071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:38.450162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:38.451953 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:38.453448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bccc084e-85e6-4eac-aaf9-14954357d1d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.184784 May 26 12:53:38.454012 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 310/649] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:38 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:38.475198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b13a3833-5434-45e7-af08-cafdfc121049 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:38.489061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b13a3833-5434-45e7-af08-cafdfc121049 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.257121 May 26 12:53:38.489859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 340/650] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:38 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:38.990594 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce8b1014-79c3-4eca-bf73-b6e59e9318a9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.991200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce8b1014-79c3-4eca-bf73-b6e59e9318a9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.997203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce8b1014-79c3-4eca-bf73-b6e59e9318a9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.997656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce8b1014-79c3-4eca-bf73-b6e59e9318a9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.998429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce8b1014-79c3-4eca-bf73-b6e59e9318a9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.998892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce8b1014-79c3-4eca-bf73-b6e59e9318a9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.003026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:39.131672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce8b1014-79c3-4eca-bf73-b6e59e9318a9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:39.139976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce8b1014-79c3-4eca-bf73-b6e59e9318a9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1724 microversion: 2.1 time: 0.154220 May 26 12:53:39.140566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 311/651] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:38 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:39.473027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:39.473682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:39.480313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.480759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.481571 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.481951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.484564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:39.505415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3bce1006-ed36-4520-bb4d-2d5ab43f414f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:39.506905 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3bce1006-ed36-4520-bb4d-2d5ab43f414f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:39.513540 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bce1006-ed36-4520-bb4d-2d5ab43f414f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.514224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bce1006-ed36-4520-bb4d-2d5ab43f414f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.515024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bce1006-ed36-4520-bb4d-2d5ab43f414f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.515461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bce1006-ed36-4520-bb4d-2d5ab43f414f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.638286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:39.647766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:39.649290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:39.650663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c8bb2ae2-3f23-42ff-8f34-28fa7eedf8b2 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.182461 May 26 12:53:39.651220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 341/652] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:39 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:39.670686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3bce1006-ed36-4520-bb4d-2d5ab43f414f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:39.679212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3bce1006-ed36-4520-bb4d-2d5ab43f414f tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.177596 May 26 12:53:39.679776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 312/653] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:39 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:40.157166 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ceb7d24d-94aa-4d03-acd6-eaccba82308a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:40.157775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ceb7d24d-94aa-4d03-acd6-eaccba82308a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:40.164819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceb7d24d-94aa-4d03-acd6-eaccba82308a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.165274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceb7d24d-94aa-4d03-acd6-eaccba82308a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.166037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceb7d24d-94aa-4d03-acd6-eaccba82308a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.166476 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceb7d24d-94aa-4d03-acd6-eaccba82308a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.300221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ceb7d24d-94aa-4d03-acd6-eaccba82308a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:40.308428 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ceb7d24d-94aa-4d03-acd6-eaccba82308a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1724 microversion: 2.1 time: 0.155120 May 26 12:53:40.308990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 342/654] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:40 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:40.669744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:40.670363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:40.677774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.678165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.678965 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.679408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.696450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d01a4344-4a4b-474a-b2ed-eb292cd7a5d4 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:40.697065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d01a4344-4a4b-474a-b2ed-eb292cd7a5d4 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:40.704008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d01a4344-4a4b-474a-b2ed-eb292cd7a5d4 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.704470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d01a4344-4a4b-474a-b2ed-eb292cd7a5d4 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.705246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d01a4344-4a4b-474a-b2ed-eb292cd7a5d4 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.705694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d01a4344-4a4b-474a-b2ed-eb292cd7a5d4 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.816165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:40.825323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:40.827262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:40.828732 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4c0c258d-4232-46cb-95da-c8c0865ec8bd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.162889 May 26 12:53:40.829286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 313/655] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:40 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:40.868188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d01a4344-4a4b-474a-b2ed-eb292cd7a5d4 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:40.876603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d01a4344-4a4b-474a-b2ed-eb292cd7a5d4 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.183942 May 26 12:53:40.877168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 343/656] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:40 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:40.899790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2f04fb79-5cbb-4858-a913-dc9c56927834 req-af912f93-b3b5-4340-92c6-e52717885064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64085992-ecfa-4fbc-a713-04aff66c0042", "name": "network-vif-plugged", "status": "completed", "tag": "1099ed7a-51bc-411b-8a61-ea93c6361abe"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:40.907776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2f04fb79-5cbb-4858-a913-dc9c56927834 req-af912f93-b3b5-4340-92c6-e52717885064 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.908221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2f04fb79-5cbb-4858-a913-dc9c56927834 req-af912f93-b3b5-4340-92c6-e52717885064 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.919495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2f04fb79-5cbb-4858-a913-dc9c56927834 req-af912f93-b3b5-4340-92c6-e52717885064 service nova] Creating event network-vif-plugged:1099ed7a-51bc-411b-8a61-ea93c6361abe for instance 64085992-ecfa-4fbc-a713-04aff66c0042 on hv-cinder-81514 May 26 12:53:40.924591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2f04fb79-5cbb-4858-a913-dc9c56927834 req-af912f93-b3b5-4340-92c6-e52717885064 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093976 May 26 12:53:40.925258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 314/657] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:41.325211 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b21097d1-6e57-4c06-890b-a7dc39e39d6e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:41.325822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b21097d1-6e57-4c06-890b-a7dc39e39d6e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:41.332185 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b21097d1-6e57-4c06-890b-a7dc39e39d6e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:41.332654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b21097d1-6e57-4c06-890b-a7dc39e39d6e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.333420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b21097d1-6e57-4c06-890b-a7dc39e39d6e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:41.333859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b21097d1-6e57-4c06-890b-a7dc39e39d6e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.459932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b21097d1-6e57-4c06-890b-a7dc39e39d6e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:41.467762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b21097d1-6e57-4c06-890b-a7dc39e39d6e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1724 microversion: 2.1 time: 0.146366 May 26 12:53:41.468333 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 344/658] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:41 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:41.850999 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:41.851712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:41.858382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:41.858927 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.859809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:41.860285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.893892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-648e9f4f-d9ac-4113-a609-f1fca3930d6b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:41.894510 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-648e9f4f-d9ac-4113-a609-f1fca3930d6b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:41.901233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-648e9f4f-d9ac-4113-a609-f1fca3930d6b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:41.901757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-648e9f4f-d9ac-4113-a609-f1fca3930d6b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.902789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-648e9f4f-d9ac-4113-a609-f1fca3930d6b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:41.903132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-648e9f4f-d9ac-4113-a609-f1fca3930d6b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.996854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:42.007481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:42.009235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:42.010637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-440a9a0b-1f07-41ec-bd58-31afd0ad67a3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.165764 May 26 12:53:42.011576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 315/659] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:41 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:42.049372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-648e9f4f-d9ac-4113-a609-f1fca3930d6b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:42.057426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-648e9f4f-d9ac-4113-a609-f1fca3930d6b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.167810 May 26 12:53:42.058042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 345/660] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:41 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:42.484799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ad7ef9de-a001-42b0-a8e0-34005593926f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:42.485413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ad7ef9de-a001-42b0-a8e0-34005593926f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:42.492104 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad7ef9de-a001-42b0-a8e0-34005593926f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.492563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad7ef9de-a001-42b0-a8e0-34005593926f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:42.493332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad7ef9de-a001-42b0-a8e0-34005593926f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.493774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad7ef9de-a001-42b0-a8e0-34005593926f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:42.624868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ad7ef9de-a001-42b0-a8e0-34005593926f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:42.633725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ad7ef9de-a001-42b0-a8e0-34005593926f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1730 microversion: 2.1 time: 0.152858 May 26 12:53:42.634281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 316/661] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:42 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:42.651503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ab9f09b-3ef5-4615-96a0-8f634c7528df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:42.651998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ab9f09b-3ef5-4615-96a0-8f634c7528df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:42.657872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ab9f09b-3ef5-4615-96a0-8f634c7528df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.658332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ab9f09b-3ef5-4615-96a0-8f634c7528df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:42.659885 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ab9f09b-3ef5-4615-96a0-8f634c7528df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.660351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ab9f09b-3ef5-4615-96a0-8f634c7528df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:42.738817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ab9f09b-3ef5-4615-96a0-8f634c7528df tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091199 May 26 12:53:42.739415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 346/662] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 26 12:53:42 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:43.029981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:43.030941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:43.038923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.039435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.040273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.040726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.076640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b2a5e6f-7f7e-481e-bf3b-cf4b6a7b0c6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:43.077253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b2a5e6f-7f7e-481e-bf3b-cf4b6a7b0c6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:43.085478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b2a5e6f-7f7e-481e-bf3b-cf4b6a7b0c6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.085939 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b2a5e6f-7f7e-481e-bf3b-cf4b6a7b0c6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.086768 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b2a5e6f-7f7e-481e-bf3b-cf4b6a7b0c6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.087214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b2a5e6f-7f7e-481e-bf3b-cf4b6a7b0c6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.179463 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:43.188469 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:43.190707 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:43.192052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd91dccc-c473-42f1-903e-e0b88df1c3d6 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.166623 May 26 12:53:43.192717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 317/663] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:43 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:43.362333 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b2a5e6f-7f7e-481e-bf3b-cf4b6a7b0c6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:43.370545 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b2a5e6f-7f7e-481e-bf3b-cf4b6a7b0c6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.298566 May 26 12:53:43.371121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 347/664] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:43 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:43.912066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-13380709-0b15-46c8-b1f3-f9d964ab1454 req-7a7305a4-6aec-4cc0-92cd-a5a7921f95ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec", "tag": "159cee84-406e-4fca-9ca2-17925ac974a1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:43.921036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-13380709-0b15-46c8-b1f3-f9d964ab1454 req-7a7305a4-6aec-4cc0-92cd-a5a7921f95ac service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:43.921527 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-13380709-0b15-46c8-b1f3-f9d964ab1454 req-7a7305a4-6aec-4cc0-92cd-a5a7921f95ac service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.933526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-13380709-0b15-46c8-b1f3-f9d964ab1454 req-7a7305a4-6aec-4cc0-92cd-a5a7921f95ac service nova] Creating event network-changed:159cee84-406e-4fca-9ca2-17925ac974a1 for instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec on hv-cinder-81514 May 26 12:53:43.938556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-13380709-0b15-46c8-b1f3-f9d964ab1454 req-7a7305a4-6aec-4cc0-92cd-a5a7921f95ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090564 May 26 12:53:43.939359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 318/665] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:44.211062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:44.211761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:44.218309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:44.218845 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:44.219614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:44.220054 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:44.355684 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:44.364625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:44.366130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:44.367327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-915bb6ce-f3be-4efd-a5e1-c325d59657b1 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.160177 May 26 12:53:44.367921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 348/666] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:44 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:44.389591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c89a71ae-1484-4a13-ac27-f0dbd9481635 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:44.391154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c89a71ae-1484-4a13-ac27-f0dbd9481635 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:44.401015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c89a71ae-1484-4a13-ac27-f0dbd9481635 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:44.401476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c89a71ae-1484-4a13-ac27-f0dbd9481635 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:44.402289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c89a71ae-1484-4a13-ac27-f0dbd9481635 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:44.402772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c89a71ae-1484-4a13-ac27-f0dbd9481635 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:44.553454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c89a71ae-1484-4a13-ac27-f0dbd9481635 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:44.561787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c89a71ae-1484-4a13-ac27-f0dbd9481635 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.176403 May 26 12:53:44.562370 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 319/667] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:44 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:45.387005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:45.387598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:45.394750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.395274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.396191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.396630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.579363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7230d3ed-eaac-4322-a121-7318987f37da tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:45.579982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7230d3ed-eaac-4322-a121-7318987f37da tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:45.586891 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7230d3ed-eaac-4322-a121-7318987f37da tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.587348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7230d3ed-eaac-4322-a121-7318987f37da tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.588130 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7230d3ed-eaac-4322-a121-7318987f37da tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.588576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7230d3ed-eaac-4322-a121-7318987f37da tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.606617 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:45.628689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:45.630216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:45.631677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f127e44-72f7-4cd2-9c52-7bac43a88479 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1807 microversion: 2.20 time: 0.248862 May 26 12:53:45.632237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 349/668] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:45 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:45.737644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7230d3ed-eaac-4322-a121-7318987f37da tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:45.745680 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7230d3ed-eaac-4322-a121-7318987f37da tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.170177 May 26 12:53:45.746250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 320/669] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:45 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:45.952613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-38d5a6c2-ed9c-4ef4-ba22-832a5450768d req-fdc71e5e-b614-4c18-b518-a05d8dfb4dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec", "tag": "159cee84-406e-4fca-9ca2-17925ac974a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:45.961455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-38d5a6c2-ed9c-4ef4-ba22-832a5450768d req-fdc71e5e-b614-4c18-b518-a05d8dfb4dae service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.961902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-38d5a6c2-ed9c-4ef4-ba22-832a5450768d req-fdc71e5e-b614-4c18-b518-a05d8dfb4dae service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.972704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-38d5a6c2-ed9c-4ef4-ba22-832a5450768d req-fdc71e5e-b614-4c18-b518-a05d8dfb4dae service nova] Creating event network-changed:159cee84-406e-4fca-9ca2-17925ac974a1 for instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec on hv-cinder-81514 May 26 12:53:45.977659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-38d5a6c2-ed9c-4ef4-ba22-832a5450768d req-fdc71e5e-b614-4c18-b518-a05d8dfb4dae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028637 May 26 12:53:45.978225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 350/670] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:46.650457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:46.651003 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:46.658071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.659382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.660243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.660693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.765363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d53e534-b019-44d6-84e6-3f6836406f89 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:46.766116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d53e534-b019-44d6-84e6-3f6836406f89 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:46.773773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d53e534-b019-44d6-84e6-3f6836406f89 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.774225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d53e534-b019-44d6-84e6-3f6836406f89 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.775024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d53e534-b019-44d6-84e6-3f6836406f89 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.775466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d53e534-b019-44d6-84e6-3f6836406f89 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.822310 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:46.830768 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:46.832297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:46.833571 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1b7acc9-3132-4bff-aed5-5a66906738f4 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1794 microversion: 2.20 time: 0.187165 May 26 12:53:46.834132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 321/671] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:53:46 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1794 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:46.925257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d53e534-b019-44d6-84e6-3f6836406f89 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:46.933428 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d53e534-b019-44d6-84e6-3f6836406f89 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.172739 May 26 12:53:46.933987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 351/672] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:46 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:47.951273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce76e5cd-2b2a-432c-8c8b-1fc3e6bf2f46 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:47.951894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce76e5cd-2b2a-432c-8c8b-1fc3e6bf2f46 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:47.958495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce76e5cd-2b2a-432c-8c8b-1fc3e6bf2f46 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:47.958982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce76e5cd-2b2a-432c-8c8b-1fc3e6bf2f46 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:47.959764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce76e5cd-2b2a-432c-8c8b-1fc3e6bf2f46 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:47.960191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce76e5cd-2b2a-432c-8c8b-1fc3e6bf2f46 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:48.099324 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce76e5cd-2b2a-432c-8c8b-1fc3e6bf2f46 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:48.113206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce76e5cd-2b2a-432c-8c8b-1fc3e6bf2f46 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.160048 May 26 12:53:48.113206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 322/673] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:47 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:49.125238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a0b651b-9dbe-43ee-b245-26141f1ace7e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:49.125851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a0b651b-9dbe-43ee-b245-26141f1ace7e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:49.133647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0b651b-9dbe-43ee-b245-26141f1ace7e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.138457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0b651b-9dbe-43ee-b245-26141f1ace7e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.138457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0b651b-9dbe-43ee-b245-26141f1ace7e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.138457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0b651b-9dbe-43ee-b245-26141f1ace7e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.278127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a0b651b-9dbe-43ee-b245-26141f1ace7e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:49.286337 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a0b651b-9dbe-43ee-b245-26141f1ace7e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1758 microversion: 2.1 time: 0.164948 May 26 12:53:49.287079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 352/674] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:49 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:50.303731 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce576df8-6230-4c12-ad59-fde296c89167 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:50.311165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce576df8-6230-4c12-ad59-fde296c89167 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:50.311165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce576df8-6230-4c12-ad59-fde296c89167 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.311390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce576df8-6230-4c12-ad59-fde296c89167 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.312138 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce576df8-6230-4c12-ad59-fde296c89167 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.312580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce576df8-6230-4c12-ad59-fde296c89167 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.474069 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce576df8-6230-4c12-ad59-fde296c89167 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:50.482108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce576df8-6230-4c12-ad59-fde296c89167 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1761 microversion: 2.1 time: 0.182224 May 26 12:53:50.482702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 323/675] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:50 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1761 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:51.204220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4d846c7b-f475-4fa9-ba8e-e9abc3f9b089 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:51.205035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4d846c7b-f475-4fa9-ba8e-e9abc3f9b089 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:51.211262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d846c7b-f475-4fa9-ba8e-e9abc3f9b089 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.211713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d846c7b-f475-4fa9-ba8e-e9abc3f9b089 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.212472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d846c7b-f475-4fa9-ba8e-e9abc3f9b089 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.212914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d846c7b-f475-4fa9-ba8e-e9abc3f9b089 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.236737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4d846c7b-f475-4fa9-ba8e-e9abc3f9b089 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261/ips" status: 200 len: 149 microversion: 2.1 time: 0.138860 May 26 12:53:51.241215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 353/676] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 12:53:51 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261/ips => generated 149 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:53:51.247970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0230b752-3b39-411b-82ba-d281ffa1e575"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:51.249026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:51.255582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.256062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.256854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.257404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.339000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Invalid volume: volume 0230b752-3b39-411b-82ba-d281ffa1e575 is already attached to instances: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261/os-volume_attachments HTTP/1.1 May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 74 May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:53:51.340720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {"volumeAttachment": {"volumeId": "0230b752-3b39-411b-82ba-d281ffa1e575"}} May 26 12:53:51.342075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Invalid volume: volume 0230b752-3b39-411b-82ba-d281ffa1e575 is already attached to instances: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'server_id': 'c8e6512b-4f9a-4929-9cdf-099229ccd261', 'body': {'volumeAttachment': {'volumeId': '0230b752-3b39-411b-82ba-d281ffa1e575'}}} May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0230b752-3b39-411b-82ba-d281ffa1e575 is already attached to instances: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:53:51.342932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0230b752-3b39-411b-82ba-d281ffa1e575 is already attached to instances: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:51.344263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:51.346519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:51.346519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:51.346519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:51.346519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0230b752-3b39-411b-82ba-d281ffa1e575 is already attached to instances: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 May 26 12:53:51.346519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:53:51.346519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 400 to user: Invalid volume: volume 0230b752-3b39-411b-82ba-d281ffa1e575 is already attached to instances: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:51.346519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f7789cd-b6a0-4e76-a546-f4f82f3ce306 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098145 May 26 12:53:51.346519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 324/677] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:53:51 2022] POST /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:53:51.351679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cde2bf7-554b-4a84-89ab-abea14161536 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:51.352172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3cde2bf7-554b-4a84-89ab-abea14161536 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:51.358118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cde2bf7-554b-4a84-89ab-abea14161536 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.358597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cde2bf7-554b-4a84-89ab-abea14161536 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.359380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cde2bf7-554b-4a84-89ab-abea14161536 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.359817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cde2bf7-554b-4a84-89ab-abea14161536 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.384560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3cde2bf7-554b-4a84-89ab-abea14161536 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:53:51.762598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3cde2bf7-554b-4a84-89ab-abea14161536 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 204 len: 0 microversion: 2.1 time: 0.414354 May 26 12:53:51.763237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 354/678] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:53:51 2022] DELETE /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:53:51.772333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99ab235e-51aa-4e2b-9b24-5e3be916ce12 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:51.772943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99ab235e-51aa-4e2b-9b24-5e3be916ce12 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:51.780291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99ab235e-51aa-4e2b-9b24-5e3be916ce12 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.780756 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99ab235e-51aa-4e2b-9b24-5e3be916ce12 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.781537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99ab235e-51aa-4e2b-9b24-5e3be916ce12 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.781967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99ab235e-51aa-4e2b-9b24-5e3be916ce12 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.918740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99ab235e-51aa-4e2b-9b24-5e3be916ce12 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:51.930239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99ab235e-51aa-4e2b-9b24-5e3be916ce12 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1680 microversion: 2.1 time: 0.160869 May 26 12:53:51.930883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 325/679] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:51 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:52.949969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f4029702-390d-45dd-8d48-4bca8bb828f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:52.950741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f4029702-390d-45dd-8d48-4bca8bb828f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:52.958161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4029702-390d-45dd-8d48-4bca8bb828f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.958629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4029702-390d-45dd-8d48-4bca8bb828f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:52.959390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4029702-390d-45dd-8d48-4bca8bb828f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.959826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4029702-390d-45dd-8d48-4bca8bb828f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:53.094894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4029702-390d-45dd-8d48-4bca8bb828f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:53.099290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f4029702-390d-45dd-8d48-4bca8bb828f9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1680 microversion: 2.1 time: 0.153561 May 26 12:53:53.099867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 355/680] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:52 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:54.117418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8d1526ee-0d4c-40d7-86b2-8d736cb2e710 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:54.118062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8d1526ee-0d4c-40d7-86b2-8d736cb2e710 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:54.124327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d1526ee-0d4c-40d7-86b2-8d736cb2e710 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.124772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d1526ee-0d4c-40d7-86b2-8d736cb2e710 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.125536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d1526ee-0d4c-40d7-86b2-8d736cb2e710 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.125969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d1526ee-0d4c-40d7-86b2-8d736cb2e710 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.258607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d1526ee-0d4c-40d7-86b2-8d736cb2e710 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:54.266445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8d1526ee-0d4c-40d7-86b2-8d736cb2e710 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1680 microversion: 2.1 time: 0.152938 May 26 12:53:54.267415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 326/681] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:54 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:54.940690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-915a6925-ddee-476f-9c80-9535629e8df4 req-eb4b8222-1212-4454-8109-44149cbd35c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e6512b-4f9a-4929-9cdf-099229ccd261", "name": "network-vif-deleted", "tag": "8854eb96-6221-4bab-b9c6-0ed3e07047a4"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:54.949175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-915a6925-ddee-476f-9c80-9535629e8df4 req-eb4b8222-1212-4454-8109-44149cbd35c9 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.949625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-915a6925-ddee-476f-9c80-9535629e8df4 req-eb4b8222-1212-4454-8109-44149cbd35c9 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.961841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-915a6925-ddee-476f-9c80-9535629e8df4 req-eb4b8222-1212-4454-8109-44149cbd35c9 service nova] Creating event network-vif-deleted:8854eb96-6221-4bab-b9c6-0ed3e07047a4 for instance c8e6512b-4f9a-4929-9cdf-099229ccd261 on hv-cinder-81514 May 26 12:53:54.967240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-915a6925-ddee-476f-9c80-9535629e8df4 req-eb4b8222-1212-4454-8109-44149cbd35c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030897 May 26 12:53:54.967829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 356/682] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:55.285441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e82860fa-d31d-447d-be0c-3a2941235880 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:55.286056 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e82860fa-d31d-447d-be0c-3a2941235880 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:55.293251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82860fa-d31d-447d-be0c-3a2941235880 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:55.293747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82860fa-d31d-447d-be0c-3a2941235880 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:55.294751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82860fa-d31d-447d-be0c-3a2941235880 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:55.295276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82860fa-d31d-447d-be0c-3a2941235880 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:55.375758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e82860fa-d31d-447d-be0c-3a2941235880 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:55.388779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e82860fa-d31d-447d-be0c-3a2941235880 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 200 len: 1326 microversion: 2.1 time: 0.108409 May 26 12:53:55.389735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 327/683] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:55 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:56.407729 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:56.408439 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:56.414721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:56.415180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:56.415949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:56.416392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:56.429460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 HTTP/1.1 May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:53:56.431111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:53:56.432546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'c8e6512b-4f9a-4929-9cdf-099229ccd261'} May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:56.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:53:56.434638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:53:56.435731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:56.435731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bee68488-598b-4bbc-8c32-ab49030928ce tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 404 len: 111 microversion: 2.1 time: 0.029678 May 26 12:53:56.435731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 357/684] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:53:56 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:56.442293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b366106c-19ba-4641-a95b-b98734d7f0b2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '.version_select at 0x7f498c1e6af0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:56.579894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b366106c-19ba-4641-a95b-b98734d7f0b2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548722360" status: 202 len: 0 microversion: 2.1 time: 0.142086 May 26 12:53:56.580384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 328/685] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 26 12:53:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548722360 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:57.414021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-baff44d3-fcaa-4c5d-bcf3-96c19d8df7ae tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:57.414617 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-baff44d3-fcaa-4c5d-bcf3-96c19d8df7ae tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:57.421442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baff44d3-fcaa-4c5d-bcf3-96c19d8df7ae tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.421906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baff44d3-fcaa-4c5d-bcf3-96c19d8df7ae tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.422728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baff44d3-fcaa-4c5d-bcf3-96c19d8df7ae tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.423726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baff44d3-fcaa-4c5d-bcf3-96c19d8df7ae tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.506797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:57.510311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-baff44d3-fcaa-4c5d-bcf3-96c19d8df7ae tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lazy-loading 'services' on Instance uuid 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:53:57.784160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-baff44d3-fcaa-4c5d-bcf3-96c19d8df7ae tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments/0230b752-3b39-411b-82ba-d281ffa1e575" status: 202 len: 0 microversion: 2.1 time: 0.374008 May 26 12:53:57.784810 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 358/686] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 12:53:57 2022] DELETE /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments/0230b752-3b39-411b-82ba-d281ffa1e575 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:57.793893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ae0563f-76ee-4bb7-a3f4-ceb47c7d4675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:57.794987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ae0563f-76ee-4bb7-a3f4-ceb47c7d4675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:57.796949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:57.802999 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ae0563f-76ee-4bb7-a3f4-ceb47c7d4675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.803535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ae0563f-76ee-4bb7-a3f4-ceb47c7d4675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.804385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ae0563f-76ee-4bb7-a3f4-ceb47c7d4675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.805041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ae0563f-76ee-4bb7-a3f4-ceb47c7d4675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.835396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ae0563f-76ee-4bb7-a3f4-ceb47c7d4675 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 May 26 12:53:57.835960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 329/687] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:53:57 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:58.848910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7046ba14-44f9-44cc-ba8f-52083f3e0307 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:58.849926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7046ba14-44f9-44cc-ba8f-52083f3e0307 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:58.856272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7046ba14-44f9-44cc-ba8f-52083f3e0307 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.856770 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7046ba14-44f9-44cc-ba8f-52083f3e0307 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.857545 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7046ba14-44f9-44cc-ba8f-52083f3e0307 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.858015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7046ba14-44f9-44cc-ba8f-52083f3e0307 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.887147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7046ba14-44f9-44cc-ba8f-52083f3e0307 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 May 26 12:53:58.887903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 359/688] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:53:58 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:59.899377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74c85fc7-203c-409b-b121-d47f6f3a0f58 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:59.900303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-74c85fc7-203c-409b-b121-d47f6f3a0f58 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:59.906960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74c85fc7-203c-409b-b121-d47f6f3a0f58 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:59.908080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74c85fc7-203c-409b-b121-d47f6f3a0f58 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:59.908859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74c85fc7-203c-409b-b121-d47f6f3a0f58 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:59.909303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74c85fc7-203c-409b-b121-d47f6f3a0f58 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:59.912935 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:59.937780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-74c85fc7-203c-409b-b121-d47f6f3a0f58 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042700 May 26 12:53:59.938333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 330/689] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:53:59 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:53:59.996112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9aa7b02-b955-424f-b3da-c6347dfd3a8c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:59.996619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9aa7b02-b955-424f-b3da-c6347dfd3a8c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:00.003315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b02-b955-424f-b3da-c6347dfd3a8c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.003767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b02-b955-424f-b3da-c6347dfd3a8c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.004528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b02-b955-424f-b3da-c6347dfd3a8c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.005222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b02-b955-424f-b3da-c6347dfd3a8c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.031915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9aa7b02-b955-424f-b3da-c6347dfd3a8c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:54:00.357328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9aa7b02-b955-424f-b3da-c6347dfd3a8c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 204 len: 0 microversion: 2.1 time: 0.364743 May 26 12:54:00.357928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 360/690] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:53:59 2022] DELETE /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:54:00.366350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ace28aa2-efff-41a9-b3f8-c3e721b52e33 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:00.366991 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ace28aa2-efff-41a9-b3f8-c3e721b52e33 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:00.373050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ace28aa2-efff-41a9-b3f8-c3e721b52e33 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.373496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ace28aa2-efff-41a9-b3f8-c3e721b52e33 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.374248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ace28aa2-efff-41a9-b3f8-c3e721b52e33 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.374730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ace28aa2-efff-41a9-b3f8-c3e721b52e33 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.505596 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ace28aa2-efff-41a9-b3f8-c3e721b52e33 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:00.513020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ace28aa2-efff-41a9-b3f8-c3e721b52e33 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1682 microversion: 2.1 time: 0.150810 May 26 12:54:00.513571 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 331/691] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:00 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:01.531360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-573f97af-83c5-4492-8239-3c968048264d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:01.532496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-573f97af-83c5-4492-8239-3c968048264d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:01.534875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:01.539595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-573f97af-83c5-4492-8239-3c968048264d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:01.540041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-573f97af-83c5-4492-8239-3c968048264d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:01.540791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-573f97af-83c5-4492-8239-3c968048264d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:01.541224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-573f97af-83c5-4492-8239-3c968048264d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:01.671673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-573f97af-83c5-4492-8239-3c968048264d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:01.679910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-573f97af-83c5-4492-8239-3c968048264d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1682 microversion: 2.1 time: 0.152780 May 26 12:54:01.680473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 361/692] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:01 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:02.601557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c08d2ff5-0c27-4ced-a94a-08354776e4aa req-52aa50f8-ce42-4d53-b259-3691c30a6e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9a6c21-74a0-432e-bcb3-c91e2c45fe15", "name": "network-vif-deleted", "tag": "b7901f5b-84cd-435a-aac3-53e7b431a21f"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:02.611019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c08d2ff5-0c27-4ced-a94a-08354776e4aa req-52aa50f8-ce42-4d53-b259-3691c30a6e2e service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.612795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c08d2ff5-0c27-4ced-a94a-08354776e4aa req-52aa50f8-ce42-4d53-b259-3691c30a6e2e service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.622928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c08d2ff5-0c27-4ced-a94a-08354776e4aa req-52aa50f8-ce42-4d53-b259-3691c30a6e2e service nova] Creating event network-vif-deleted:b7901f5b-84cd-435a-aac3-53e7b431a21f for instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 on hv-cinder-81514 May 26 12:54:02.628209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c08d2ff5-0c27-4ced-a94a-08354776e4aa req-52aa50f8-ce42-4d53-b259-3691c30a6e2e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031334 May 26 12:54:02.629158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 332/693] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:02.697829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c80520cd-a0c2-43b7-a748-f0f0b6d82efa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:02.698367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c80520cd-a0c2-43b7-a748-f0f0b6d82efa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:02.706160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80520cd-a0c2-43b7-a748-f0f0b6d82efa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.706952 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80520cd-a0c2-43b7-a748-f0f0b6d82efa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.707739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80520cd-a0c2-43b7-a748-f0f0b6d82efa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.708803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80520cd-a0c2-43b7-a748-f0f0b6d82efa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.778745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c80520cd-a0c2-43b7-a748-f0f0b6d82efa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:02.787714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c80520cd-a0c2-43b7-a748-f0f0b6d82efa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 200 len: 1615 microversion: 2.1 time: 0.094049 May 26 12:54:02.789511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 362/694] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:02 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:03.810905 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:03.811530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:03.817959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:03.818406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:03.819198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:03.819631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:03.837402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 HTTP/1.1 May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:54:03.839063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:54:03.840582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '3f9a6c21-74a0-432e-bcb3-c91e2c45fe15'} May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:03.841404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:54:03.842619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:54:03.843650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:03.843650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5acda8da-a1da-46dc-9c07-1073637c0f0a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 404 len: 111 microversion: 2.1 time: 0.038793 May 26 12:54:03.843650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 333/695] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:03 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:03.850016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ed135bf-d187-473f-9787-8ac8800e0fb2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '.version_select at 0x7f498c1aed30>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:03.939066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ed135bf-d187-473f-9787-8ac8800e0fb2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155804079" status: 202 len: 0 microversion: 2.1 time: 0.092664 May 26 12:54:03.939633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 363/696] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 26 12:54:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155804079 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:04.742179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eef0e09a-c30c-4963-8f48-048b614ed6c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: .version_select at 0x7f498c19d310>, body: {"keypair": {"name": "tempest-keypair-753206291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6UIupOnuRCQqCinMXNbAgBAowFVjaj/ea9PB38yjYDMNTbmV2QPKhadoL1fobzlJr4bWf4ikQoay8aguoEBde4opz9sBTfoBDMrQ55UKqFDSj2x6Ei3F43yUlMIW76bQ=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:04.756609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-eef0e09a-c30c-4963-8f48-048b614ed6c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:54:04.760369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-eef0e09a-c30c-4963-8f48-048b614ed6c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for user 98a275f65a3544a5b073fbf1ee10034b and project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:54:04.838028 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eef0e09a-c30c-4963-8f48-048b614ed6c3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099674 May 26 12:54:04.838685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 334/697] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 12:54:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:07.121678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-151751847", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6687087-b2c6-4c92-a8ec-55292a7bb20d"}], "security_groups": [{"name": "tempest-securitygroup--1418583680"}], "key_name": "tempest-keypair-753206291", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:07.228284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] validate_networks() for [('f6687087-b2c6-4c92-a8ec-55292a7bb20d', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:54:07.637330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:54:07.637761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:54:07.638268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:54:07.638713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:54:07.639134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:54:07.649739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.650191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.651080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.651583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.669616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:54:07.673862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for user 98a275f65a3544a5b073fbf1ee10034b and project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:54:07.685855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:54:07.688183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:54:07.801783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [8b369ab4-8635-459d-bab8-6555c60d0b13] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 12:54:08.809983 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [8b369ab4-8635-459d-bab8-6555c60d0b13] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48364. May 26 12:54:08.814143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-909ff1e3-2f46-40b9-865a-15ddb2fa1291 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.697386 May 26 12:54:08.814832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 364/698] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:54:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:54:08.825341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1317450f-96b2-4a0c-abc9-269b0651ef57 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:08.825955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1317450f-96b2-4a0c-abc9-269b0651ef57 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:08.884395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1317450f-96b2-4a0c-abc9-269b0651ef57 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:08.891052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1317450f-96b2-4a0c-abc9-269b0651ef57 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1240 microversion: 2.1 time: 0.070256 May 26 12:54:08.891787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 335/699] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:08 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:09.910125 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89f52416-e5cd-4c7e-9147-7e399ca8599f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:09.910851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-89f52416-e5cd-4c7e-9147-7e399ca8599f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:09.965521 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-89f52416-e5cd-4c7e-9147-7e399ca8599f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:09.972942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-89f52416-e5cd-4c7e-9147-7e399ca8599f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1240 microversion: 2.1 time: 0.067885 May 26 12:54:09.973502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 365/700] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:09 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:10.990025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14fb33eb-e0cc-4e99-b898-5dbfcb0e1ca4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:10.990686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14fb33eb-e0cc-4e99-b898-5dbfcb0e1ca4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:11.043498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14fb33eb-e0cc-4e99-b898-5dbfcb0e1ca4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:11.051187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14fb33eb-e0cc-4e99-b898-5dbfcb0e1ca4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1240 microversion: 2.1 time: 0.066075 May 26 12:54:11.053721 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 336/701] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:10 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:12.068319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0505b417-71c6-4b58-983c-11c14e1229d1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:12.068968 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0505b417-71c6-4b58-983c-11c14e1229d1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:12.121228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0505b417-71c6-4b58-983c-11c14e1229d1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:12.129356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0505b417-71c6-4b58-983c-11c14e1229d1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1240 microversion: 2.1 time: 0.065122 May 26 12:54:12.130132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 366/702] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:12 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:13.146841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb5cd491-62d1-4a85-998c-25cf56b69290 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:13.147458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb5cd491-62d1-4a85-998c-25cf56b69290 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:13.154647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb5cd491-62d1-4a85-998c-25cf56b69290 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.155099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb5cd491-62d1-4a85-998c-25cf56b69290 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.155864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb5cd491-62d1-4a85-998c-25cf56b69290 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.156305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb5cd491-62d1-4a85-998c-25cf56b69290 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.217697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eb5cd491-62d1-4a85-998c-25cf56b69290 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:13.225810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb5cd491-62d1-4a85-998c-25cf56b69290 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1244 microversion: 2.1 time: 0.083345 May 26 12:54:13.226379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 337/703] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:13 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:14.243022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f4b96119-7d57-4e95-9f22-88472a284bb0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:14.243647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f4b96119-7d57-4e95-9f22-88472a284bb0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:14.250477 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4b96119-7d57-4e95-9f22-88472a284bb0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:14.251275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4b96119-7d57-4e95-9f22-88472a284bb0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:14.252359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4b96119-7d57-4e95-9f22-88472a284bb0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:14.252923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4b96119-7d57-4e95-9f22-88472a284bb0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:14.322593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4b96119-7d57-4e95-9f22-88472a284bb0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:14.332731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f4b96119-7d57-4e95-9f22-88472a284bb0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1236 microversion: 2.1 time: 0.091612 May 26 12:54:14.332731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 367/704] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:14 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1236 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:15.348258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-63500d5d-4446-4407-a1a4-ce8cea7d69d9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:15.348906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-63500d5d-4446-4407-a1a4-ce8cea7d69d9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:15.356247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63500d5d-4446-4407-a1a4-ce8cea7d69d9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:15.356736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63500d5d-4446-4407-a1a4-ce8cea7d69d9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:15.357518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63500d5d-4446-4407-a1a4-ce8cea7d69d9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:15.358072 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63500d5d-4446-4407-a1a4-ce8cea7d69d9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:15.426716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-63500d5d-4446-4407-a1a4-ce8cea7d69d9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:15.435396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-63500d5d-4446-4407-a1a4-ce8cea7d69d9 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1310 microversion: 2.1 time: 0.090988 May 26 12:54:15.436134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 338/705] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:15 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:16.453480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9fd354f-cc3a-442d-82bb-c97b44e14816 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:16.454079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9fd354f-cc3a-442d-82bb-c97b44e14816 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:16.461683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9fd354f-cc3a-442d-82bb-c97b44e14816 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:16.462145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9fd354f-cc3a-442d-82bb-c97b44e14816 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:16.462944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9fd354f-cc3a-442d-82bb-c97b44e14816 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:16.463383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9fd354f-cc3a-442d-82bb-c97b44e14816 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:16.721232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9fd354f-cc3a-442d-82bb-c97b44e14816 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:16.728585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9fd354f-cc3a-442d-82bb-c97b44e14816 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.278987 May 26 12:54:16.730974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 368/706] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:16 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:17.101192 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-f19e92f9-4162-4763-a2cb-fabf0e8ad0ab req-c759f6fa-0fa3-4afa-8473-fa6da688ad7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084c31a2-f433-4477-8388-749a59d8b900", "tag": "bc9f078e-34df-406e-a07b-b8120022ff12"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:17.109575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-f19e92f9-4162-4763-a2cb-fabf0e8ad0ab req-c759f6fa-0fa3-4afa-8473-fa6da688ad7b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:17.110021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-f19e92f9-4162-4763-a2cb-fabf0e8ad0ab req-c759f6fa-0fa3-4afa-8473-fa6da688ad7b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:17.122689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-f19e92f9-4162-4763-a2cb-fabf0e8ad0ab req-c759f6fa-0fa3-4afa-8473-fa6da688ad7b service nova] Creating event network-changed:bc9f078e-34df-406e-a07b-b8120022ff12 for instance 084c31a2-f433-4477-8388-749a59d8b900 on hv-cinder-81514 May 26 12:54:17.128798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-f19e92f9-4162-4763-a2cb-fabf0e8ad0ab req-c759f6fa-0fa3-4afa-8473-fa6da688ad7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030704 May 26 12:54:17.129724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 339/707] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:17.746363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45eb2b77-1096-4e8e-941e-3c1a500853cc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:17.746923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45eb2b77-1096-4e8e-941e-3c1a500853cc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:17.749220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:17.754382 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45eb2b77-1096-4e8e-941e-3c1a500853cc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:17.759096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45eb2b77-1096-4e8e-941e-3c1a500853cc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:17.759096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45eb2b77-1096-4e8e-941e-3c1a500853cc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:17.759096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45eb2b77-1096-4e8e-941e-3c1a500853cc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:17.956197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45eb2b77-1096-4e8e-941e-3c1a500853cc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:17.963776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45eb2b77-1096-4e8e-941e-3c1a500853cc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.221369 May 26 12:54:17.964335 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 369/708] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:17 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:18.981547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0c2890f6-bcfa-44f3-8b3c-a170ff6b7d51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:18.982247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0c2890f6-bcfa-44f3-8b3c-a170ff6b7d51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:18.989404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c2890f6-bcfa-44f3-8b3c-a170ff6b7d51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.989853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c2890f6-bcfa-44f3-8b3c-a170ff6b7d51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:18.990648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c2890f6-bcfa-44f3-8b3c-a170ff6b7d51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.991089 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c2890f6-bcfa-44f3-8b3c-a170ff6b7d51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:19.119677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0c2890f6-bcfa-44f3-8b3c-a170ff6b7d51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:19.127326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0c2890f6-bcfa-44f3-8b3c-a170ff6b7d51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.150172 May 26 12:54:19.127936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 340/709] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:18 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:20.144658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f05b03fa-d4d2-4e18-97d1-0cd9e2708d9a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:20.145280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f05b03fa-d4d2-4e18-97d1-0cd9e2708d9a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:20.151764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05b03fa-d4d2-4e18-97d1-0cd9e2708d9a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:20.152314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05b03fa-d4d2-4e18-97d1-0cd9e2708d9a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:20.153084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05b03fa-d4d2-4e18-97d1-0cd9e2708d9a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:20.153525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05b03fa-d4d2-4e18-97d1-0cd9e2708d9a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:20.299633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f05b03fa-d4d2-4e18-97d1-0cd9e2708d9a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:20.307121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f05b03fa-d4d2-4e18-97d1-0cd9e2708d9a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.166612 May 26 12:54:20.307688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 370/710] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:20 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:21.323503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5fc3e1e4-e301-4443-8f0c-2df9fb1a2dc6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:21.324126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5fc3e1e4-e301-4443-8f0c-2df9fb1a2dc6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:21.326688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:21.335829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fc3e1e4-e301-4443-8f0c-2df9fb1a2dc6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:21.337942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fc3e1e4-e301-4443-8f0c-2df9fb1a2dc6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:21.337942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fc3e1e4-e301-4443-8f0c-2df9fb1a2dc6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:21.337942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fc3e1e4-e301-4443-8f0c-2df9fb1a2dc6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:21.467834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5fc3e1e4-e301-4443-8f0c-2df9fb1a2dc6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:21.475625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5fc3e1e4-e301-4443-8f0c-2df9fb1a2dc6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.156355 May 26 12:54:21.480919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 341/711] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:21 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:22.492258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15df9322-aff5-40e2-91f9-877dd3e37a30 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:22.492866 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15df9322-aff5-40e2-91f9-877dd3e37a30 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:22.495158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:22.499921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15df9322-aff5-40e2-91f9-877dd3e37a30 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:22.500368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15df9322-aff5-40e2-91f9-877dd3e37a30 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:22.501128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15df9322-aff5-40e2-91f9-877dd3e37a30 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:22.502205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15df9322-aff5-40e2-91f9-877dd3e37a30 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:22.636088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15df9322-aff5-40e2-91f9-877dd3e37a30 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:22.644696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15df9322-aff5-40e2-91f9-877dd3e37a30 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.156181 May 26 12:54:22.655745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 371/712] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:22 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:23.666379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d478fac-1e67-4280-b344-56d917559acb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:23.667019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d478fac-1e67-4280-b344-56d917559acb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:23.673382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d478fac-1e67-4280-b344-56d917559acb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:23.673931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d478fac-1e67-4280-b344-56d917559acb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:23.674739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d478fac-1e67-4280-b344-56d917559acb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:23.675180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d478fac-1e67-4280-b344-56d917559acb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:23.805399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d478fac-1e67-4280-b344-56d917559acb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:23.812720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d478fac-1e67-4280-b344-56d917559acb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.150187 May 26 12:54:23.813276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 342/713] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:23 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:24.824709 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-60d47269-7952-4f44-ac04-a20cd4f0f01d req-84a68147-f360-4a5c-942a-53514c3f4dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084c31a2-f433-4477-8388-749a59d8b900", "name": "network-vif-plugged", "status": "completed", "tag": "bc9f078e-34df-406e-a07b-b8120022ff12"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:24.830257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2914c796-079b-42d2-b4be-c8f2c4ae034e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:24.830912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2914c796-079b-42d2-b4be-c8f2c4ae034e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:24.833413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-60d47269-7952-4f44-ac04-a20cd4f0f01d req-84a68147-f360-4a5c-942a-53514c3f4dbd service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:24.833953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-60d47269-7952-4f44-ac04-a20cd4f0f01d req-84a68147-f360-4a5c-942a-53514c3f4dbd service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:24.837623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2914c796-079b-42d2-b4be-c8f2c4ae034e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:24.838186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2914c796-079b-42d2-b4be-c8f2c4ae034e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:24.838934 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2914c796-079b-42d2-b4be-c8f2c4ae034e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:24.839375 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2914c796-079b-42d2-b4be-c8f2c4ae034e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:24.845682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-60d47269-7952-4f44-ac04-a20cd4f0f01d req-84a68147-f360-4a5c-942a-53514c3f4dbd service nova] Creating event network-vif-plugged:bc9f078e-34df-406e-a07b-b8120022ff12 for instance 084c31a2-f433-4477-8388-749a59d8b900 on hv-cinder-81514 May 26 12:54:24.850791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-60d47269-7952-4f44-ac04-a20cd4f0f01d req-84a68147-f360-4a5c-942a-53514c3f4dbd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029956 May 26 12:54:24.851379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 372/714] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:24.973541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2914c796-079b-42d2-b4be-c8f2c4ae034e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:24.983217 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2914c796-079b-42d2-b4be-c8f2c4ae034e tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.156199 May 26 12:54:24.983217 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 343/715] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:24 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:25.999626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9fae3937-9667-46c6-807b-262be3f3267d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:26.000360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9fae3937-9667-46c6-807b-262be3f3267d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:26.008105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fae3937-9667-46c6-807b-262be3f3267d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:26.008563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fae3937-9667-46c6-807b-262be3f3267d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:26.009330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fae3937-9667-46c6-807b-262be3f3267d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:26.009773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fae3937-9667-46c6-807b-262be3f3267d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:26.138386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9fae3937-9667-46c6-807b-262be3f3267d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:26.146092 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9fae3937-9667-46c6-807b-262be3f3267d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1366 microversion: 2.1 time: 0.150633 May 26 12:54:26.146672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 373/716] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:25 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:27.162479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ee4a839f-d05e-4a27-8104-dc1b804f13b0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:27.163119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ee4a839f-d05e-4a27-8104-dc1b804f13b0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:27.169716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee4a839f-d05e-4a27-8104-dc1b804f13b0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:27.170166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee4a839f-d05e-4a27-8104-dc1b804f13b0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:27.170960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee4a839f-d05e-4a27-8104-dc1b804f13b0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:27.171395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee4a839f-d05e-4a27-8104-dc1b804f13b0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:27.302090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ee4a839f-d05e-4a27-8104-dc1b804f13b0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:27.309481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ee4a839f-d05e-4a27-8104-dc1b804f13b0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1557 microversion: 2.1 time: 0.151056 May 26 12:54:27.310039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 344/717] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:27 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:27.327123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b0455ba3-3f16-4b3b-b4eb-5f20cfdd4bbd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:27.327640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b0455ba3-3f16-4b3b-b4eb-5f20cfdd4bbd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:27.334144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0455ba3-3f16-4b3b-b4eb-5f20cfdd4bbd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:27.334635 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0455ba3-3f16-4b3b-b4eb-5f20cfdd4bbd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:27.335399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0455ba3-3f16-4b3b-b4eb-5f20cfdd4bbd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:27.335835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0455ba3-3f16-4b3b-b4eb-5f20cfdd4bbd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:27.415289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b0455ba3-3f16-4b3b-b4eb-5f20cfdd4bbd tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091915 May 26 12:54:27.415910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 374/718] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 26 12:54:27 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:28.391080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-7326667f-381f-403b-ab54-a45761efb393 req-c9c4985a-74be-460d-8392-fd9a2dfdd288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084c31a2-f433-4477-8388-749a59d8b900", "tag": "bc9f078e-34df-406e-a07b-b8120022ff12"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:28.402739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7326667f-381f-403b-ab54-a45761efb393 req-c9c4985a-74be-460d-8392-fd9a2dfdd288 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:28.404999 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7326667f-381f-403b-ab54-a45761efb393 req-c9c4985a-74be-460d-8392-fd9a2dfdd288 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:28.414789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-7326667f-381f-403b-ab54-a45761efb393 req-c9c4985a-74be-460d-8392-fd9a2dfdd288 service nova] Creating event network-changed:bc9f078e-34df-406e-a07b-b8120022ff12 for instance 084c31a2-f433-4477-8388-749a59d8b900 on hv-cinder-81514 May 26 12:54:28.419876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-7326667f-381f-403b-ab54-a45761efb393 req-c9c4985a-74be-460d-8392-fd9a2dfdd288 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032394 May 26 12:54:28.420803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 345/719] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:41.003329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:41.003863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:41.007651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b590f127-6b72-493a-98bf-46ea83f62f8d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:41.008180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b590f127-6b72-493a-98bf-46ea83f62f8d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:41.013972 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b590f127-6b72-493a-98bf-46ea83f62f8d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.021579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b590f127-6b72-493a-98bf-46ea83f62f8d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.021579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b590f127-6b72-493a-98bf-46ea83f62f8d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.021579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b590f127-6b72-493a-98bf-46ea83f62f8d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.039508 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-b590f127-6b72-493a-98bf-46ea83f62f8d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lazy-loading 'flavor' on Instance uuid 6f3a12be-8748-41ab-a6a4-17d666ea34d0 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:54:41.300193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b590f127-6b72-493a-98bf-46ea83f62f8d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "POST /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0/action" status: 202 len: 0 microversion: 2.1 time: 0.299140 May 26 12:54:41.300857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 375/720] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:54:40 2022] POST /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:41.307489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:41.313791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=60 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:41.313791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50becaeb-9c57-4a92-a96b-0400590b5832 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:41.313791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50becaeb-9c57-4a92-a96b-0400590b5832 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:41.320851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50becaeb-9c57-4a92-a96b-0400590b5832 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.321307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50becaeb-9c57-4a92-a96b-0400590b5832 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.322090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50becaeb-9c57-4a92-a96b-0400590b5832 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.322606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50becaeb-9c57-4a92-a96b-0400590b5832 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.458494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50becaeb-9c57-4a92-a96b-0400590b5832 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:41.466121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50becaeb-9c57-4a92-a96b-0400590b5832 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.160442 May 26 12:54:41.466719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 346/721] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:41 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:42.485490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee8da6ee-6fb8-48e0-88fe-6646844fd059 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:42.486227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee8da6ee-6fb8-48e0-88fe-6646844fd059 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:42.493661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee8da6ee-6fb8-48e0-88fe-6646844fd059 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:42.494118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee8da6ee-6fb8-48e0-88fe-6646844fd059 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:42.494925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee8da6ee-6fb8-48e0-88fe-6646844fd059 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:42.495389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee8da6ee-6fb8-48e0-88fe-6646844fd059 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:42.631891 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee8da6ee-6fb8-48e0-88fe-6646844fd059 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:42.639466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee8da6ee-6fb8-48e0-88fe-6646844fd059 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.159050 May 26 12:54:42.640027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 376/722] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:42 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:43.657138 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e32d525-a282-4c91-9f0a-6c78cfe1bb34 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:43.657747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e32d525-a282-4c91-9f0a-6c78cfe1bb34 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:43.666781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e32d525-a282-4c91-9f0a-6c78cfe1bb34 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:43.667237 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e32d525-a282-4c91-9f0a-6c78cfe1bb34 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:43.668010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e32d525-a282-4c91-9f0a-6c78cfe1bb34 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:43.668449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e32d525-a282-4c91-9f0a-6c78cfe1bb34 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:43.797864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e32d525-a282-4c91-9f0a-6c78cfe1bb34 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:43.805586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e32d525-a282-4c91-9f0a-6c78cfe1bb34 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.152256 May 26 12:54:43.806210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 347/723] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:43 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:44.822796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-28b3bbb2-272b-445d-b9e1-108e80b081cc tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:44.823403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-28b3bbb2-272b-445d-b9e1-108e80b081cc tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:44.830020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28b3bbb2-272b-445d-b9e1-108e80b081cc tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:44.830472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28b3bbb2-272b-445d-b9e1-108e80b081cc tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:44.831254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28b3bbb2-272b-445d-b9e1-108e80b081cc tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:44.831687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28b3bbb2-272b-445d-b9e1-108e80b081cc tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:44.967050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-28b3bbb2-272b-445d-b9e1-108e80b081cc tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:44.975935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-28b3bbb2-272b-445d-b9e1-108e80b081cc tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.156931 May 26 12:54:44.976518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 377/724] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:44 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:45.993903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-29a29ccf-fcec-4538-8a66-72d314ba6503 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:45.994614 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-29a29ccf-fcec-4538-8a66-72d314ba6503 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:46.000907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29a29ccf-fcec-4538-8a66-72d314ba6503 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:46.001360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29a29ccf-fcec-4538-8a66-72d314ba6503 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:46.002384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29a29ccf-fcec-4538-8a66-72d314ba6503 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:46.002853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29a29ccf-fcec-4538-8a66-72d314ba6503 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:46.135422 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-29a29ccf-fcec-4538-8a66-72d314ba6503 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:46.142864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-29a29ccf-fcec-4538-8a66-72d314ba6503 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.152936 May 26 12:54:46.143433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 348/725] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:45 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:47.159642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-096d4f68-f2b7-47d5-8f49-f46d5d6fe518 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:47.160396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-096d4f68-f2b7-47d5-8f49-f46d5d6fe518 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:47.167139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-096d4f68-f2b7-47d5-8f49-f46d5d6fe518 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:47.167538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-096d4f68-f2b7-47d5-8f49-f46d5d6fe518 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:47.168300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-096d4f68-f2b7-47d5-8f49-f46d5d6fe518 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:47.168738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-096d4f68-f2b7-47d5-8f49-f46d5d6fe518 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:47.297409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-096d4f68-f2b7-47d5-8f49-f46d5d6fe518 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:47.304902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-096d4f68-f2b7-47d5-8f49-f46d5d6fe518 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.149062 May 26 12:54:47.305466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 378/726] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:47 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:48.322628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fa9ccf5c-9bdb-4e19-89c4-2da4168a23fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:48.322628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fa9ccf5c-9bdb-4e19-89c4-2da4168a23fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:48.328314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa9ccf5c-9bdb-4e19-89c4-2da4168a23fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:48.328776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa9ccf5c-9bdb-4e19-89c4-2da4168a23fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:48.329549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa9ccf5c-9bdb-4e19-89c4-2da4168a23fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:48.329996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa9ccf5c-9bdb-4e19-89c4-2da4168a23fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:48.461467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fa9ccf5c-9bdb-4e19-89c4-2da4168a23fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:48.468913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fa9ccf5c-9bdb-4e19-89c4-2da4168a23fb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.151692 May 26 12:54:48.469479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 349/727] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:48 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:49.487095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-29b12451-5666-432a-a8f2-29abfd9f8ca9 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:49.487691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-29b12451-5666-432a-a8f2-29abfd9f8ca9 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:49.494348 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29b12451-5666-432a-a8f2-29abfd9f8ca9 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:49.494832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29b12451-5666-432a-a8f2-29abfd9f8ca9 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:49.495612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29b12451-5666-432a-a8f2-29abfd9f8ca9 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:49.496045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29b12451-5666-432a-a8f2-29abfd9f8ca9 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:49.628328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-29b12451-5666-432a-a8f2-29abfd9f8ca9 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:49.635895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-29b12451-5666-432a-a8f2-29abfd9f8ca9 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.152758 May 26 12:54:49.636456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 379/728] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:49 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:50.653438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8006dfe2-6548-4b2e-9025-ce0c4106e2a2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:50.654076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8006dfe2-6548-4b2e-9025-ce0c4106e2a2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:50.660928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8006dfe2-6548-4b2e-9025-ce0c4106e2a2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:50.661385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8006dfe2-6548-4b2e-9025-ce0c4106e2a2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:50.662189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8006dfe2-6548-4b2e-9025-ce0c4106e2a2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:50.662663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8006dfe2-6548-4b2e-9025-ce0c4106e2a2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:50.791177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8006dfe2-6548-4b2e-9025-ce0c4106e2a2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:50.798711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8006dfe2-6548-4b2e-9025-ce0c4106e2a2 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.149197 May 26 12:54:50.799437 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 350/729] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:50 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:51.816431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6669474-3aa6-44b4-a339-5cea5f133c80 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:51.821873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6669474-3aa6-44b4-a339-5cea5f133c80 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:51.823821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6669474-3aa6-44b4-a339-5cea5f133c80 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:51.824272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6669474-3aa6-44b4-a339-5cea5f133c80 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:51.825034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6669474-3aa6-44b4-a339-5cea5f133c80 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:51.825576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6669474-3aa6-44b4-a339-5cea5f133c80 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:52.027121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6669474-3aa6-44b4-a339-5cea5f133c80 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:52.035503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6669474-3aa6-44b4-a339-5cea5f133c80 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.222255 May 26 12:54:52.036079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 380/730] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:51 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:53.053460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b2e38c45-e51e-49d7-8e0f-7f5aac3d890a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:53.054075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b2e38c45-e51e-49d7-8e0f-7f5aac3d890a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:53.060377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2e38c45-e51e-49d7-8e0f-7f5aac3d890a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:53.060826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2e38c45-e51e-49d7-8e0f-7f5aac3d890a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:53.061586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2e38c45-e51e-49d7-8e0f-7f5aac3d890a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:53.062024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2e38c45-e51e-49d7-8e0f-7f5aac3d890a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:53.194121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b2e38c45-e51e-49d7-8e0f-7f5aac3d890a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:53.201637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b2e38c45-e51e-49d7-8e0f-7f5aac3d890a tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.153100 May 26 12:54:53.202191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 351/731] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:53 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:54.220371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-390d170f-510e-499b-8615-82bc3984612c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:54.221014 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-390d170f-510e-499b-8615-82bc3984612c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:54.227754 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-390d170f-510e-499b-8615-82bc3984612c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.228201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-390d170f-510e-499b-8615-82bc3984612c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.228967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-390d170f-510e-499b-8615-82bc3984612c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.229400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-390d170f-510e-499b-8615-82bc3984612c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.323250 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ca95255-a233-4f70-8330-fdc1706bc8ab tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:54.323632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ca95255-a233-4f70-8330-fdc1706bc8ab tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:54.329948 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ca95255-a233-4f70-8330-fdc1706bc8ab tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.333329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ca95255-a233-4f70-8330-fdc1706bc8ab tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.333329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ca95255-a233-4f70-8330-fdc1706bc8ab tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.333329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ca95255-a233-4f70-8330-fdc1706bc8ab tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.360726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ca95255-a233-4f70-8330-fdc1706bc8ab tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments/8bdb215d-fcef-485a-aa5c-400018305935" status: 200 len: 194 microversion: 2.20 time: 0.168081 May 26 12:54:54.361395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 381/732] 10.222.0.60 () {60 vars in 1453 bytes} [Thu May 26 12:54:54 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments/8bdb215d-fcef-485a-aa5c-400018305935 => generated 194 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:54:54.380349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-390d170f-510e-499b-8615-82bc3984612c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:54.387835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-390d170f-510e-499b-8615-82bc3984612c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.171270 May 26 12:54:54.388400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 352/733] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:54 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:54.426493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a776787d-fb44-4725-8455-a075f4ec2587 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:54.427001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a776787d-fb44-4725-8455-a075f4ec2587 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:54.433246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a776787d-fb44-4725-8455-a075f4ec2587 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.433702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a776787d-fb44-4725-8455-a075f4ec2587 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.434471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a776787d-fb44-4725-8455-a075f4ec2587 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.434945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a776787d-fb44-4725-8455-a075f4ec2587 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.516828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-a776787d-fb44-4725-8455-a075f4ec2587 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lazy-loading 'services' on Instance uuid 64085992-ecfa-4fbc-a713-04aff66c0042 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:54:54.827752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a776787d-fb44-4725-8455-a075f4ec2587 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments/8bdb215d-fcef-485a-aa5c-400018305935" status: 202 len: 0 microversion: 2.20 time: 0.405596 May 26 12:54:54.828273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 382/734] 10.222.0.60 () {60 vars in 1456 bytes} [Thu May 26 12:54:54 2022] DELETE /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments/8bdb215d-fcef-485a-aa5c-400018305935 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:54:54.837854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9750324a-cca5-4c47-b2c7-f783c544e16c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:54.840228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9750324a-cca5-4c47-b2c7-f783c544e16c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:54.845140 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9750324a-cca5-4c47-b2c7-f783c544e16c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.845600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9750324a-cca5-4c47-b2c7-f783c544e16c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.846379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9750324a-cca5-4c47-b2c7-f783c544e16c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.846849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9750324a-cca5-4c47-b2c7-f783c544e16c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.877327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9750324a-cca5-4c47-b2c7-f783c544e16c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044418 May 26 12:54:54.877879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 353/735] 10.222.0.60 () {60 vars in 1342 bytes} [Thu May 26 12:54:54 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:54:55.405699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6be5eb82-5cee-4b7f-95d2-61628e346c41 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:55.406421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6be5eb82-5cee-4b7f-95d2-61628e346c41 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:55.413012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6be5eb82-5cee-4b7f-95d2-61628e346c41 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.413460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6be5eb82-5cee-4b7f-95d2-61628e346c41 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.414216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6be5eb82-5cee-4b7f-95d2-61628e346c41 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.414679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6be5eb82-5cee-4b7f-95d2-61628e346c41 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.548105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6be5eb82-5cee-4b7f-95d2-61628e346c41 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:55.556029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6be5eb82-5cee-4b7f-95d2-61628e346c41 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1571 microversion: 2.1 time: 0.155035 May 26 12:54:55.556638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 383/736] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:55 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:55.573950 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e56f3873-a4da-415b-9147-3e4bb634e446 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:55.579214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e56f3873-a4da-415b-9147-3e4bb634e446 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:55.581190 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e56f3873-a4da-415b-9147-3e4bb634e446 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.581637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e56f3873-a4da-415b-9147-3e4bb634e446 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.583296 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e56f3873-a4da-415b-9147-3e4bb634e446 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.583915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e56f3873-a4da-415b-9147-3e4bb634e446 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.833942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e56f3873-a4da-415b-9147-3e4bb634e446 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "POST /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0/action" status: 202 len: 0 microversion: 2.1 time: 0.264566 May 26 12:54:55.834475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 354/737] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:54:55 2022] POST /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:55.842420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e247ffd-5d0d-4e07-a2b9-035ff2d69796 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:55.843153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e247ffd-5d0d-4e07-a2b9-035ff2d69796 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:55.849497 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e247ffd-5d0d-4e07-a2b9-035ff2d69796 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.850021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e247ffd-5d0d-4e07-a2b9-035ff2d69796 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.850884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e247ffd-5d0d-4e07-a2b9-035ff2d69796 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.851319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e247ffd-5d0d-4e07-a2b9-035ff2d69796 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.889134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-528e10f0-4d96-4d56-a11e-6477f98e6251 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:55.890762 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-528e10f0-4d96-4d56-a11e-6477f98e6251 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:55.897107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-528e10f0-4d96-4d56-a11e-6477f98e6251 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.897578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-528e10f0-4d96-4d56-a11e-6477f98e6251 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.898352 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-528e10f0-4d96-4d56-a11e-6477f98e6251 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.898822 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-528e10f0-4d96-4d56-a11e-6477f98e6251 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.937977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-528e10f0-4d96-4d56-a11e-6477f98e6251 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052598 May 26 12:54:55.938474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 355/738] 10.222.0.60 () {60 vars in 1342 bytes} [Thu May 26 12:54:55 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:54:56.023281 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e247ffd-5d0d-4e07-a2b9-035ff2d69796 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:56.031282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e247ffd-5d0d-4e07-a2b9-035ff2d69796 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1579 microversion: 2.1 time: 0.192509 May 26 12:54:56.032121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 384/739] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:55 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:56.949907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4badb2a6-b492-4ce5-b595-8ae8908f6ee8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:56.950943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4badb2a6-b492-4ce5-b595-8ae8908f6ee8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:56.957004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4badb2a6-b492-4ce5-b595-8ae8908f6ee8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:56.957451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4badb2a6-b492-4ce5-b595-8ae8908f6ee8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:56.958777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4badb2a6-b492-4ce5-b595-8ae8908f6ee8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:56.959265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4badb2a6-b492-4ce5-b595-8ae8908f6ee8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:56.987800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4badb2a6-b492-4ce5-b595-8ae8908f6ee8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041975 May 26 12:54:56.988348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 356/740] 10.222.0.60 () {60 vars in 1342 bytes} [Thu May 26 12:54:56 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:57.045618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb0fbe28-dd57-4248-bafc-bcef04c9c33a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:57.047028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb0fbe28-dd57-4248-bafc-bcef04c9c33a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:57.048871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1171d749-5c2f-482a-bfdf-67949f9fef61 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:57.049484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1171d749-5c2f-482a-bfdf-67949f9fef61 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:57.055851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1171d749-5c2f-482a-bfdf-67949f9fef61 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:57.057001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb0fbe28-dd57-4248-bafc-bcef04c9c33a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:57.057001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb0fbe28-dd57-4248-bafc-bcef04c9c33a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:57.057393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1171d749-5c2f-482a-bfdf-67949f9fef61 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:57.057969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb0fbe28-dd57-4248-bafc-bcef04c9c33a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:57.058184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1171d749-5c2f-482a-bfdf-67949f9fef61 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:57.058704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb0fbe28-dd57-4248-bafc-bcef04c9c33a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:57.058820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1171d749-5c2f-482a-bfdf-67949f9fef61 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:57.086008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb0fbe28-dd57-4248-bafc-bcef04c9c33a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:54:57.197412 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1171d749-5c2f-482a-bfdf-67949f9fef61 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:57.204876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1171d749-5c2f-482a-bfdf-67949f9fef61 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1521 microversion: 2.1 time: 0.159771 May 26 12:54:57.212481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 357/741] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:57 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:57.437564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb0fbe28-dd57-4248-bafc-bcef04c9c33a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 204 len: 0 microversion: 2.20 time: 0.395368 May 26 12:54:57.438215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 385/742] 10.222.0.60 () {60 vars in 1279 bytes} [Thu May 26 12:54:57 2022] DELETE /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:54:57.447390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:57.447939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:57.454010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:57.454460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:57.455258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:57.455688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:57.584124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:57.592102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:57.593624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:57.594985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-507aa430-bb77-4a72-b62b-ee687faada93 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.152416 May 26 12:54:57.595535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 358/743] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:54:57 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:54:58.223599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9580ead4-9697-4ff0-b9fe-bc377e406c6d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:58.224868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9580ead4-9697-4ff0-b9fe-bc377e406c6d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:58.231387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9580ead4-9697-4ff0-b9fe-bc377e406c6d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:58.231909 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9580ead4-9697-4ff0-b9fe-bc377e406c6d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:58.232675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9580ead4-9697-4ff0-b9fe-bc377e406c6d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:58.233141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9580ead4-9697-4ff0-b9fe-bc377e406c6d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:58.364002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9580ead4-9697-4ff0-b9fe-bc377e406c6d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:58.372406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9580ead4-9697-4ff0-b9fe-bc377e406c6d tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1521 microversion: 2.1 time: 0.153181 May 26 12:54:58.374724 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 386/744] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:58 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:58.615185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:58.615805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:58.622363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:58.622842 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:58.623609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:58.624057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:58.757473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:58.765644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:58.767193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:58.768356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b506ed5c-ee22-4e7b-98b1-e9227306e16d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.157877 May 26 12:54:58.768915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 359/745] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:54:58 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:54:58.980473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-818eae7a-605a-4c7c-8df4-ee1b288e62dc req-8bea8a09-c48d-4b1c-b079-f6e3ec716f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a12be-8748-41ab-a6a4-17d666ea34d0", "name": "network-vif-unplugged", "status": "completed", "tag": "e5d66805-9eb5-4134-a395-25cf61316cc2"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:58.989220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-818eae7a-605a-4c7c-8df4-ee1b288e62dc req-8bea8a09-c48d-4b1c-b079-f6e3ec716f9a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:58.990049 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-818eae7a-605a-4c7c-8df4-ee1b288e62dc req-8bea8a09-c48d-4b1c-b079-f6e3ec716f9a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:58.994101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:59.001671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.compute.server_external_events [req-818eae7a-605a-4c7c-8df4-ee1b288e62dc req-8bea8a09-c48d-4b1c-b079-f6e3ec716f9a service nova] Unable to find a host for instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0. Dropping event network-vif-unplugged {{(pid=124831) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 12:54:59.002586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-818eae7a-605a-4c7c-8df4-ee1b288e62dc req-8bea8a09-c48d-4b1c-b079-f6e3ec716f9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026878 May 26 12:54:59.003165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 387/746] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 12:54:59.322447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c66fde4e-8da3-4c2f-a7e9-466c771c1642 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1099913049"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:59.323003 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c66fde4e-8da3-4c2f-a7e9-466c771c1642 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:59.328982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c66fde4e-8da3-4c2f-a7e9-466c771c1642 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.329435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c66fde4e-8da3-4c2f-a7e9-466c771c1642 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.330196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c66fde4e-8da3-4c2f-a7e9-466c771c1642 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.330668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c66fde4e-8da3-4c2f-a7e9-466c771c1642 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.391610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-62119b72-a4e7-41f9-a63a-52b3bd1d038c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:59.392323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-62119b72-a4e7-41f9-a63a-52b3bd1d038c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:59.401554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62119b72-a4e7-41f9-a63a-52b3bd1d038c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.402024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62119b72-a4e7-41f9-a63a-52b3bd1d038c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.402896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62119b72-a4e7-41f9-a63a-52b3bd1d038c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.403336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62119b72-a4e7-41f9-a63a-52b3bd1d038c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.468407 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.network.security_group_api [None req-c66fde4e-8da3-4c2f-a7e9-466c771c1642 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Removing security group 2f549eab-58aa-4d73-ade4-7f0c29aa5d95 from port fc34668d-8f02-4867-b0e0-992d7f4dad7d May 26 12:54:59.549729 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-62119b72-a4e7-41f9-a63a-52b3bd1d038c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:59.559811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-62119b72-a4e7-41f9-a63a-52b3bd1d038c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1521 microversion: 2.1 time: 0.172953 May 26 12:54:59.561027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 388/747] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:54:59 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:59.789658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:59.790492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:59.796982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.797556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.798607 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.799158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.976475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c66fde4e-8da3-4c2f-a7e9-466c771c1642 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "POST /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/action" status: 202 len: 0 microversion: 2.1 time: 0.658412 May 26 12:54:59.977029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 360/748] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 12:54:59 2022] POST /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:59.982905 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e530d0bf-d572-4962-a88c-9fd48ccf23db tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:59.983406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e530d0bf-d572-4962-a88c-9fd48ccf23db tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:59.994268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e530d0bf-d572-4962-a88c-9fd48ccf23db tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.995134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e530d0bf-d572-4962-a88c-9fd48ccf23db tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.996788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e530d0bf-d572-4962-a88c-9fd48ccf23db tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.997399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e530d0bf-d572-4962-a88c-9fd48ccf23db tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.194015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:00.199611 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-e530d0bf-d572-4962-a88c-9fd48ccf23db tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lazy-loading 'services' on Instance uuid 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:00.416440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:00.431803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:00.434936 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:00.436679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-624b3149-f78b-469c-9465-4c7305c5195c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1722 microversion: 2.20 time: 0.651683 May 26 12:55:00.455232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 389/749] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:54:59 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:55:00.490735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e530d0bf-d572-4962-a88c-9fd48ccf23db tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments/cbdfcf55-c9c6-4db5-8b59-a176ae3fbfc4" status: 202 len: 0 microversion: 2.1 time: 0.512544 May 26 12:55:00.496025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 361/750] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 12:54:59 2022] DELETE /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments/cbdfcf55-c9c6-4db5-8b59-a176ae3fbfc4 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:00.510333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8f41895-814c-40c2-a5c1-0360462e7805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:00.511537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8f41895-814c-40c2-a5c1-0360462e7805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:00.518512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8f41895-814c-40c2-a5c1-0360462e7805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.519036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8f41895-814c-40c2-a5c1-0360462e7805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.520134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8f41895-814c-40c2-a5c1-0360462e7805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.520309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8f41895-814c-40c2-a5c1-0360462e7805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.545772 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c3e3a8db-959f-4391-a5ec-2260d3541828 req-6c9269ea-d188-4c21-8c1a-292a4b3c6a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e5b57b-24ad-473d-9c97-b337fbac6fdc", "tag": "fc34668d-8f02-4867-b0e0-992d7f4dad7d"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:00.554844 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c3e3a8db-959f-4391-a5ec-2260d3541828 req-6c9269ea-d188-4c21-8c1a-292a4b3c6a31 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.555553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c3e3a8db-959f-4391-a5ec-2260d3541828 req-6c9269ea-d188-4c21-8c1a-292a4b3c6a31 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.564750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8f41895-814c-40c2-a5c1-0360462e7805 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067044 May 26 12:55:00.570060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 362/751] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:00 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:55:00.571455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c3e3a8db-959f-4391-a5ec-2260d3541828 req-6c9269ea-d188-4c21-8c1a-292a4b3c6a31 service nova] Creating event network-changed:fc34668d-8f02-4867-b0e0-992d7f4dad7d for instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc on hv-cinder-81514 May 26 12:55:00.576958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-c3e3a8db-959f-4391-a5ec-2260d3541828 req-6c9269ea-d188-4c21-8c1a-292a4b3c6a31 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120194 May 26 12:55:00.578120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 390/752] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:00.578498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdbdc8eb-86db-40fb-ba95-3caedd69b364 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:00.579084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cdbdc8eb-86db-40fb-ba95-3caedd69b364 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:00.587766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdbdc8eb-86db-40fb-ba95-3caedd69b364 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.587766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdbdc8eb-86db-40fb-ba95-3caedd69b364 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.589227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdbdc8eb-86db-40fb-ba95-3caedd69b364 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.589920 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdbdc8eb-86db-40fb-ba95-3caedd69b364 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:01.084248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cdbdc8eb-86db-40fb-ba95-3caedd69b364 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:01.092287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdbdc8eb-86db-40fb-ba95-3caedd69b364 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.518937 May 26 12:55:01.092861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 363/753] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:00 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:01.457253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:01.459317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:01.467060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:01.467609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:01.468456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:01.468963 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:01.579393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4a4fa7a1-32ea-458e-9f01-321015d1b251 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:01.587584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4a4fa7a1-32ea-458e-9f01-321015d1b251 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:01.588844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a4fa7a1-32ea-458e-9f01-321015d1b251 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:01.589625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a4fa7a1-32ea-458e-9f01-321015d1b251 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:01.590939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a4fa7a1-32ea-458e-9f01-321015d1b251 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:01.591632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a4fa7a1-32ea-458e-9f01-321015d1b251 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:01.615151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:01.626843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:01.631570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:01.632899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a135228-5f62-4cf8-b3a3-d2817c60fc09 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1655 microversion: 2.20 time: 0.179988 May 26 12:55:01.633746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 391/754] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:01 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:01.640759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-18eedc0f-8db7-4ff6-9fb9-066f6ef88e00 req-58a85c37-c376-4c98-94d7-9e21d675c755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64085992-ecfa-4fbc-a713-04aff66c0042", "name": "network-vif-deleted", "tag": "1099ed7a-51bc-411b-8a61-ea93c6361abe"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:01.649915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4a4fa7a1-32ea-458e-9f01-321015d1b251 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075036 May 26 12:55:01.650254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-18eedc0f-8db7-4ff6-9fb9-066f6ef88e00 req-58a85c37-c376-4c98-94d7-9e21d675c755 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:01.653698 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 364/755] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:01 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:01.653893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-18eedc0f-8db7-4ff6-9fb9-066f6ef88e00 req-58a85c37-c376-4c98-94d7-9e21d675c755 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:01.663228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-18eedc0f-8db7-4ff6-9fb9-066f6ef88e00 req-58a85c37-c376-4c98-94d7-9e21d675c755 service nova] Creating event network-vif-deleted:1099ed7a-51bc-411b-8a61-ea93c6361abe for instance 64085992-ecfa-4fbc-a713-04aff66c0042 on hv-cinder-81514 May 26 12:55:01.668265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-18eedc0f-8db7-4ff6-9fb9-066f6ef88e00 req-58a85c37-c376-4c98-94d7-9e21d675c755 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031685 May 26 12:55:01.668859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 392/756] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:02.109493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0cf03345-8f3f-4d67-bd9d-51dd2e036de7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:02.113559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0cf03345-8f3f-4d67-bd9d-51dd2e036de7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:02.124980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cf03345-8f3f-4d67-bd9d-51dd2e036de7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.128505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cf03345-8f3f-4d67-bd9d-51dd2e036de7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.134378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cf03345-8f3f-4d67-bd9d-51dd2e036de7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.134875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cf03345-8f3f-4d67-bd9d-51dd2e036de7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.139135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b0768760-1fbf-429e-a8ad-b5e125e88a9b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:02.139950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b0768760-1fbf-429e-a8ad-b5e125e88a9b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:02.147655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0768760-1fbf-429e-a8ad-b5e125e88a9b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.148228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0768760-1fbf-429e-a8ad-b5e125e88a9b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.149161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0768760-1fbf-429e-a8ad-b5e125e88a9b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.149700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0768760-1fbf-429e-a8ad-b5e125e88a9b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.239226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-b0768760-1fbf-429e-a8ad-b5e125e88a9b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lazy-loading 'services' on Instance uuid 43e5b57b-24ad-473d-9c97-b337fbac6fdc {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:02.316418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0cf03345-8f3f-4d67-bd9d-51dd2e036de7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:02.326702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0cf03345-8f3f-4d67-bd9d-51dd2e036de7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.220395 May 26 12:55:02.337057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 365/757] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:02 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:02.491107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b0768760-1fbf-429e-a8ad-b5e125e88a9b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "DELETE /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments/11a81afd-720a-48bb-9ef7-efea04a1c941" status: 202 len: 0 microversion: 2.1 time: 0.356170 May 26 12:55:02.494981 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 393/758] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 12:55:02 2022] DELETE /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments/11a81afd-720a-48bb-9ef7-efea04a1c941 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:55:02.505716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba655688-dc34-4eeb-9855-cd6d92a098d2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:02.507282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba655688-dc34-4eeb-9855-cd6d92a098d2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:02.514839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba655688-dc34-4eeb-9855-cd6d92a098d2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.515295 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba655688-dc34-4eeb-9855-cd6d92a098d2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.516258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba655688-dc34-4eeb-9855-cd6d92a098d2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.516970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba655688-dc34-4eeb-9855-cd6d92a098d2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.555941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba655688-dc34-4eeb-9855-cd6d92a098d2 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056966 May 26 12:55:02.557234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 366/759] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:02 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:02.656309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:02.657176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:02.662192 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8a6ec56-3dd6-4212-9845-200758ec4e8f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:02.663612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8a6ec56-3dd6-4212-9845-200758ec4e8f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:02.665635 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.666476 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.667542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.668624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.697829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8a6ec56-3dd6-4212-9845-200758ec4e8f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.711876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8a6ec56-3dd6-4212-9845-200758ec4e8f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.713443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8a6ec56-3dd6-4212-9845-200758ec4e8f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.715204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8a6ec56-3dd6-4212-9845-200758ec4e8f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.777503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:02.787843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:02.789840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:02.790976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8a6ec56-3dd6-4212-9845-200758ec4e8f tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133526 May 26 12:55:02.791824 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f5544d4f-4349-49a0-bd14-b86de41a8284 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1365 microversion: 2.20 time: 0.142101 May 26 12:55:02.792226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 367/760] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:02 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:55:02.794010 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 394/761] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:02 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:02.879115 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75de45cd-23bf-4d0f-bf67-908905da4683 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:02.880477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75de45cd-23bf-4d0f-bf67-908905da4683 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:02.887283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75de45cd-23bf-4d0f-bf67-908905da4683 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.887740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75de45cd-23bf-4d0f-bf67-908905da4683 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.888598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75de45cd-23bf-4d0f-bf67-908905da4683 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.889037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75de45cd-23bf-4d0f-bf67-908905da4683 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.919344 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75de45cd-23bf-4d0f-bf67-908905da4683 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:55:03.242172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75de45cd-23bf-4d0f-bf67-908905da4683 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 204 len: 0 microversion: 2.1 time: 0.366712 May 26 12:55:03.243178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 368/762] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:55:02 2022] DELETE /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:55:03.251794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10552308-e6b6-4ed0-9f56-5f7d79b665f9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:03.252637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10552308-e6b6-4ed0-9f56-5f7d79b665f9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:03.262727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10552308-e6b6-4ed0-9f56-5f7d79b665f9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.263458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10552308-e6b6-4ed0-9f56-5f7d79b665f9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.264444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10552308-e6b6-4ed0-9f56-5f7d79b665f9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.264890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10552308-e6b6-4ed0-9f56-5f7d79b665f9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.352559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-02ee1d71-873b-432b-bdf5-3af6179fee3c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:03.354054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-02ee1d71-873b-432b-bdf5-3af6179fee3c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:03.363619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02ee1d71-873b-432b-bdf5-3af6179fee3c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.365162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02ee1d71-873b-432b-bdf5-3af6179fee3c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.367004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02ee1d71-873b-432b-bdf5-3af6179fee3c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.367118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02ee1d71-873b-432b-bdf5-3af6179fee3c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.452135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10552308-e6b6-4ed0-9f56-5f7d79b665f9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:03.463993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10552308-e6b6-4ed0-9f56-5f7d79b665f9 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1690 microversion: 2.1 time: 0.216594 May 26 12:55:03.466575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 395/763] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:03 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:03.542293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02ee1d71-873b-432b-bdf5-3af6179fee3c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:03.549765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-02ee1d71-873b-432b-bdf5-3af6179fee3c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.204855 May 26 12:55:03.550414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 369/764] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:03 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:03.570878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1b87d8a2-9980-4a0a-8b01-e5f2dc2c2ddd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:03.571896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1b87d8a2-9980-4a0a-8b01-e5f2dc2c2ddd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:03.578124 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b87d8a2-9980-4a0a-8b01-e5f2dc2c2ddd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.578665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b87d8a2-9980-4a0a-8b01-e5f2dc2c2ddd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.579427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b87d8a2-9980-4a0a-8b01-e5f2dc2c2ddd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.579862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b87d8a2-9980-4a0a-8b01-e5f2dc2c2ddd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.608808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1b87d8a2-9980-4a0a-8b01-e5f2dc2c2ddd tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 May 26 12:55:03.609359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 396/765] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:03 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:03.682962 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-14612d2c-b9b7-4746-ae4d-080de27451a3 req-fe736306-dc10-4eed-8b50-927f3aa92c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e5b57b-24ad-473d-9c97-b337fbac6fdc", "tag": "fc34668d-8f02-4867-b0e0-992d7f4dad7d"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:03.691300 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-14612d2c-b9b7-4746-ae4d-080de27451a3 req-fe736306-dc10-4eed-8b50-927f3aa92c23 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.691751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-14612d2c-b9b7-4746-ae4d-080de27451a3 req-fe736306-dc10-4eed-8b50-927f3aa92c23 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.703036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-14612d2c-b9b7-4746-ae4d-080de27451a3 req-fe736306-dc10-4eed-8b50-927f3aa92c23 service nova] Creating event network-changed:fc34668d-8f02-4867-b0e0-992d7f4dad7d for instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc on hv-cinder-81514 May 26 12:55:03.708620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-14612d2c-b9b7-4746-ae4d-080de27451a3 req-fe736306-dc10-4eed-8b50-927f3aa92c23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028629 May 26 12:55:03.709183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 370/766] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:03.811782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:03.812323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:03.818763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.823793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.823793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.823793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.850116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.850612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.851041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lazy-loading 'fault' on Instance uuid 64085992-ecfa-4fbc-a713-04aff66c0042 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:03.895222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:03.903068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:03.904570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:03.905743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-977818d6-cece-4a61-ada1-e42073d07497 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1370 microversion: 2.20 time: 0.097857 May 26 12:55:03.906298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 397/767] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:03 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:04.482613 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-267ac636-ba9d-4469-955b-ed1da54baeb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:04.483316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-267ac636-ba9d-4469-955b-ed1da54baeb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:04.490718 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-267ac636-ba9d-4469-955b-ed1da54baeb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.491174 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-267ac636-ba9d-4469-955b-ed1da54baeb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.491942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-267ac636-ba9d-4469-955b-ed1da54baeb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.492384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-267ac636-ba9d-4469-955b-ed1da54baeb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.570558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c3ab0a1-2a50-41a9-a7ab-1ef912083a4b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:04.571725 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c3ab0a1-2a50-41a9-a7ab-1ef912083a4b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:04.579324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c3ab0a1-2a50-41a9-a7ab-1ef912083a4b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.579808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c3ab0a1-2a50-41a9-a7ab-1ef912083a4b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.580583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c3ab0a1-2a50-41a9-a7ab-1ef912083a4b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.581028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c3ab0a1-2a50-41a9-a7ab-1ef912083a4b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.624417 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-267ac636-ba9d-4469-955b-ed1da54baeb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:04.632272 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-267ac636-ba9d-4469-955b-ed1da54baeb3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1690 microversion: 2.1 time: 0.153895 May 26 12:55:04.633934 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 371/768] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:04 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:04.638073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbbe0a37-2f68-4c0c-859b-fb41fb86e793 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:04.639025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbbe0a37-2f68-4c0c-859b-fb41fb86e793 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:04.644874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbbe0a37-2f68-4c0c-859b-fb41fb86e793 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.645942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbbe0a37-2f68-4c0c-859b-fb41fb86e793 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.646685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbbe0a37-2f68-4c0c-859b-fb41fb86e793 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.647126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbbe0a37-2f68-4c0c-859b-fb41fb86e793 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.678226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbbe0a37-2f68-4c0c-859b-fb41fb86e793 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 May 26 12:55:04.678834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 372/769] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:04 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:04.717727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c3ab0a1-2a50-41a9-a7ab-1ef912083a4b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:04.726120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c3ab0a1-2a50-41a9-a7ab-1ef912083a4b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.162599 May 26 12:55:04.726779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 398/770] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:04 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:04.924312 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:04.924925 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:04.931354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.931803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.932564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.933002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.962908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.963355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.963793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lazy-loading 'fault' on Instance uuid 64085992-ecfa-4fbc-a713-04aff66c0042 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:05.008010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:05.015856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:05.017369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:05.018505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d7b727c-8af8-4469-a9d1-68c37ba8fae7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1370 microversion: 2.20 time: 0.098122 May 26 12:55:05.019105 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 373/771] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:04 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:05.649546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-60450893-ae07-484b-867d-34996504e470 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:05.650156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-60450893-ae07-484b-867d-34996504e470 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:05.656667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60450893-ae07-484b-867d-34996504e470 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:05.657119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60450893-ae07-484b-867d-34996504e470 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:05.657870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60450893-ae07-484b-867d-34996504e470 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:05.658301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60450893-ae07-484b-867d-34996504e470 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:05.689262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e6c79e2-89b3-4226-a763-a247aae77429 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:05.690188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e6c79e2-89b3-4226-a763-a247aae77429 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:05.697006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e6c79e2-89b3-4226-a763-a247aae77429 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:05.697457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e6c79e2-89b3-4226-a763-a247aae77429 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:05.698236 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e6c79e2-89b3-4226-a763-a247aae77429 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:05.698732 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e6c79e2-89b3-4226-a763-a247aae77429 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:05.727907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e6c79e2-89b3-4226-a763-a247aae77429 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 May 26 12:55:05.728471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 374/772] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:05 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:55:05.743532 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e3259af0-befa-4a8c-ba28-0a3d6d8c3fc7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:05.744200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e3259af0-befa-4a8c-ba28-0a3d6d8c3fc7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:05.750112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3259af0-befa-4a8c-ba28-0a3d6d8c3fc7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:05.751165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3259af0-befa-4a8c-ba28-0a3d6d8c3fc7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:05.751617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3259af0-befa-4a8c-ba28-0a3d6d8c3fc7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:05.752051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3259af0-befa-4a8c-ba28-0a3d6d8c3fc7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:05.791930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-60450893-ae07-484b-867d-34996504e470 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:05.799488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-60450893-ae07-484b-867d-34996504e470 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1690 microversion: 2.1 time: 0.153832 May 26 12:55:05.800068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 399/773] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:05 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:05.883094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e3259af0-befa-4a8c-ba28-0a3d6d8c3fc7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:05.892168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e3259af0-befa-4a8c-ba28-0a3d6d8c3fc7 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.152452 May 26 12:55:05.893227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 375/774] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:05 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:06.037664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:06.038183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:06.044163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.044638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.045401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.045855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.076608 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.077063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.077514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lazy-loading 'fault' on Instance uuid 64085992-ecfa-4fbc-a713-04aff66c0042 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:06.118784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:06.126943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:06.128444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:06.129723 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f7f78d0-7455-4550-9efb-3d6b543d824e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1370 microversion: 2.20 time: 0.096495 May 26 12:55:06.130352 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 400/775] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:06 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:06.739540 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7d45c786-b974-4358-8ed7-20258a2dfda6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:06.740445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7d45c786-b974-4358-8ed7-20258a2dfda6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:06.747033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d45c786-b974-4358-8ed7-20258a2dfda6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.747475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d45c786-b974-4358-8ed7-20258a2dfda6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.748293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d45c786-b974-4358-8ed7-20258a2dfda6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.748725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d45c786-b974-4358-8ed7-20258a2dfda6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.765544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:06.780913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7d45c786-b974-4358-8ed7-20258a2dfda6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 May 26 12:55:06.781472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 376/776] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:06 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:06.817736 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be5241af-bbec-4b48-9487-4fb62cc59c8a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:06.818388 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be5241af-bbec-4b48-9487-4fb62cc59c8a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:06.824934 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be5241af-bbec-4b48-9487-4fb62cc59c8a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.825379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be5241af-bbec-4b48-9487-4fb62cc59c8a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.826135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be5241af-bbec-4b48-9487-4fb62cc59c8a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.826667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be5241af-bbec-4b48-9487-4fb62cc59c8a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.913795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db45a21f-f583-4833-bdd5-78494eb786cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:06.914434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db45a21f-f583-4833-bdd5-78494eb786cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:06.921322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db45a21f-f583-4833-bdd5-78494eb786cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.921712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db45a21f-f583-4833-bdd5-78494eb786cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.923023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db45a21f-f583-4833-bdd5-78494eb786cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.923023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db45a21f-f583-4833-bdd5-78494eb786cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.960646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be5241af-bbec-4b48-9487-4fb62cc59c8a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:06.970233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be5241af-bbec-4b48-9487-4fb62cc59c8a tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1690 microversion: 2.1 time: 0.156898 May 26 12:55:06.970838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 401/777] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:06 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:07.147811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:07.148557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:07.155251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.155708 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.156490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.156937 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.168379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db45a21f-f583-4833-bdd5-78494eb786cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:07.178040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db45a21f-f583-4833-bdd5-78494eb786cb tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.268240 May 26 12:55:07.189562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 377/778] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:06 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:07.201344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.202268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.202447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lazy-loading 'fault' on Instance uuid 64085992-ecfa-4fbc-a713-04aff66c0042 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:07.251503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:07.264865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:07.266447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:07.267667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a6968a0-69ea-4b4b-9141-d82923ebe6a9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 200 len: 1370 microversion: 2.20 time: 0.124511 May 26 12:55:07.268559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 402/779] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:07 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 1370 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:55:07.793737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d2804c8a-0eb5-4f9d-bdf2-8ed06416a8f0 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:07.794789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d2804c8a-0eb5-4f9d-bdf2-8ed06416a8f0 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:07.802297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2804c8a-0eb5-4f9d-bdf2-8ed06416a8f0 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.802776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2804c8a-0eb5-4f9d-bdf2-8ed06416a8f0 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.803562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2804c8a-0eb5-4f9d-bdf2-8ed06416a8f0 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.804004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2804c8a-0eb5-4f9d-bdf2-8ed06416a8f0 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.833972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d2804c8a-0eb5-4f9d-bdf2-8ed06416a8f0 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044241 May 26 12:55:07.834563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 378/780] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:07 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:55:07.844409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:07.847374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:07.852911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.853374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.854129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.854586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.932109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] HTTP exception thrown: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc is not attached to volume 11a81afd-720a-48bb-9ef7-efea04a1c941 May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Request method failure captured: May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments/11a81afd-720a-48bb-9ef7-efea04a1c941 HTTP/1.1 May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3eNo_FdeUGENB648TJ27EN_qjFMin-XxvYjjInT1T4LlUZX4nGvrWXdoGTohqnkFZWh_oX8gSdgxuw_q8bnkLVXUfUd0FjFVZB2lIjOdc-BFHljB-KZuWWGMGGI6T9zBvr3IUFykRnFADP177Ka66Vdu_tnf_WTPT9MFYHJd8VS6eU May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: b7059688f7a24761b61e51820c78a2ab May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestMinimumBasicScenario-2002535439 May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:55:07.948449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b7059688f7a24761b61e51820c78a2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b7059688f7a24761b61e51820c78a2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b7059688f7a24761b61e51820c78a2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b7059688f7a24761b61e51820c78a2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestMinimumBasicScenario-2002535439 May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: b7059688f7a24761b61e51820c78a2ab May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2002535439 May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-TestMinimumBasicScenario-2002535439-project May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: db52c21a4c58422fa7ccad6232fc8f21 May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestMinimumBasicScenario-2002535439-project May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:55:07.950121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc is not attached to volume 11a81afd-720a-48bb-9ef7-efea04a1c941 May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '43e5b57b-24ad-473d-9c97-b337fbac6fdc', 'id': '11a81afd-720a-48bb-9ef7-efea04a1c941'} May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 11a81afd-720a-48bb-9ef7-efea04a1c941. May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:07.951045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc is not attached to volume 11a81afd-720a-48bb-9ef7-efea04a1c941 May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc is not attached to volume 11a81afd-720a-48bb-9ef7-efea04a1c941 May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:07.955530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Returning 404 to user: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc is not attached to volume 11a81afd-720a-48bb-9ef7-efea04a1c941 {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:07.956664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7a12a133-dd47-4bcb-b5e1-3c3831871ea6 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "DELETE /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments/11a81afd-720a-48bb-9ef7-efea04a1c941" status: 404 len: 154 microversion: 2.1 time: 0.110906 May 26 12:55:07.956664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 403/781] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 12:55:07 2022] DELETE /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc/os-volume_attachments/11a81afd-720a-48bb-9ef7-efea04a1c941 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:55:07.987245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-101bc91c-8038-4606-8643-bed028469020 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:07.987828 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-101bc91c-8038-4606-8643-bed028469020 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:07.993995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-101bc91c-8038-4606-8643-bed028469020 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.994444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-101bc91c-8038-4606-8643-bed028469020 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.995249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-101bc91c-8038-4606-8643-bed028469020 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.995684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-101bc91c-8038-4606-8643-bed028469020 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.054511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-ffecd2b1-0abc-4f17-b78c-c71ee9c7f567 req-2bedf110-417c-48ee-b93a-2ba5bc2066ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec", "name": "network-vif-deleted", "tag": "159cee84-406e-4fca-9ca2-17925ac974a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:08.066104 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ffecd2b1-0abc-4f17-b78c-c71ee9c7f567 req-2bedf110-417c-48ee-b93a-2ba5bc2066ca service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.067336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ffecd2b1-0abc-4f17-b78c-c71ee9c7f567 req-2bedf110-417c-48ee-b93a-2ba5bc2066ca service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.068941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-101bc91c-8038-4606-8643-bed028469020 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:08.081883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:08.091330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-ffecd2b1-0abc-4f17-b78c-c71ee9c7f567 req-2bedf110-417c-48ee-b93a-2ba5bc2066ca service nova] Creating event network-vif-deleted:159cee84-406e-4fca-9ca2-17925ac974a1 for instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec on hv-cinder-81514 May 26 12:55:08.094210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-101bc91c-8038-4606-8643-bed028469020 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1622 microversion: 2.1 time: 0.110438 May 26 12:55:08.094835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 379/782] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:07 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1622 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:08.101326 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-ffecd2b1-0abc-4f17-b78c-c71ee9c7f567 req-2bedf110-417c-48ee-b93a-2ba5bc2066ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051956 May 26 12:55:08.102007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 404/783] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:55:08.197751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50ed4a40-72f5-4bc4-bb16-ccd5e4660f11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:08.198362 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50ed4a40-72f5-4bc4-bb16-ccd5e4660f11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:08.210548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50ed4a40-72f5-4bc4-bb16-ccd5e4660f11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.211536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50ed4a40-72f5-4bc4-bb16-ccd5e4660f11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.212635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50ed4a40-72f5-4bc4-bb16-ccd5e4660f11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.213252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50ed4a40-72f5-4bc4-bb16-ccd5e4660f11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.287428 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:08.288437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:08.299258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.299258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.299258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.299258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.314619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] HTTP exception thrown: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Request method failure captured: May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 HTTP/1.1 May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3demH7vRot_pDpKEmKgJ7vEmkbv78VjDaygZxCTnTuYMWzvPehg3crBpHMFHRg4VdTwO7mI33K9nBEcRaljvR1VNAw3f23VZZ0fzASiXcQUw12Hzbvbv5t__lmktFsqFMruq7JWgH8TGE3VJ0DTaTx7ylRStTh00BDGMpQ7kWGlyUU May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:55:08.316426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60655349037a415e8d26e794e9d3cc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 34cd6fbd9b654e31a387acc25ee94d44 May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:55:08.318319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '64085992-ecfa-4fbc-a713-04aff66c0042'} May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:08.319201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:55:08.320526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:08.321659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Returning 404 to user: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:08.321659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d825e61-d48f-4a45-9321-01e2842e0b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 404 len: 111 microversion: 2.20 time: 0.036753 May 26 12:55:08.321659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 405/784] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:08 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:55:08.328473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45204625-d7eb-4eeb-a39e-bad9cb6a2376 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '.version_select at 0x7f4986fdc940>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:08.383349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50ed4a40-72f5-4bc4-bb16-ccd5e4660f11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:08.408938 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50ed4a40-72f5-4bc4-bb16-ccd5e4660f11 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.214998 May 26 12:55:08.409525 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 380/785] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:08 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:08.423707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45204625-d7eb-4eeb-a39e-bad9cb6a2376 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142527771" status: 204 len: 0 microversion: 2.20 time: 0.098907 May 26 12:55:08.424314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 406/786] 10.222.0.60 () {60 vars in 1261 bytes} [Thu May 26 12:55:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142527771 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 12:55:09.115374 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:09.116174 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:09.122579 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.123015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.123788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.124230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.165165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.165637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.166325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lazy-loading 'fault' on Instance uuid 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:09.223599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:09.231514 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f82ad6c3-bf5b-4a63-bce1-a59eef47c682 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 200 len: 1335 microversion: 2.1 time: 0.120889 May 26 12:55:09.232421 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 381/787] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:09 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:09.314720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9091aea-4e37-4164-83ed-7af4689c9b4b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:09.315458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9091aea-4e37-4164-83ed-7af4689c9b4b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:09.322917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-393c7274-5e32-41d9-a199-91d1b28fbfd5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'create', calling method: .version_select at 0x7f498c19cdc0>, body: {"keypair": {"name": "tempest-keypair-461462108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK02cORNmFB4EGiWWQ5X4CWCMRueD8GjHAMwEsW761nsRpAsxmfjuoghLjDy1ouZ+GQbLoyGPkiKneUtO2R34b8Q9YH1qV+xuB0QwQdPVyTfjTF1NQ8QAHIDajIxDQcJw=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:09.325714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9091aea-4e37-4164-83ed-7af4689c9b4b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.325714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9091aea-4e37-4164-83ed-7af4689c9b4b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.325714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9091aea-4e37-4164-83ed-7af4689c9b4b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.326264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9091aea-4e37-4164-83ed-7af4689c9b4b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.337665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-393c7274-5e32-41d9-a199-91d1b28fbfd5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Getting quotas for project 60655349037a415e8d26e794e9d3cc79. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:55:09.341492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-393c7274-5e32-41d9-a199-91d1b28fbfd5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Getting quotas for user 34cd6fbd9b654e31a387acc25ee94d44 and project 60655349037a415e8d26e794e9d3cc79. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:55:09.352161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9091aea-4e37-4164-83ed-7af4689c9b4b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:55:09.428738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-393c7274-5e32-41d9-a199-91d1b28fbfd5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.109726 May 26 12:55:09.442981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 382/788] 10.222.0.60 () {62 vars in 1199 bytes} [Thu May 26 12:55:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 12:55:09.442981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2f3b727-b263-47d2-8a05-9c9f96fc1879 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:09.442981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2f3b727-b263-47d2-8a05-9c9f96fc1879 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:09.442981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2f3b727-b263-47d2-8a05-9c9f96fc1879 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.442981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2f3b727-b263-47d2-8a05-9c9f96fc1879 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.443637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2f3b727-b263-47d2-8a05-9c9f96fc1879 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.443637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2f3b727-b263-47d2-8a05-9c9f96fc1879 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.626186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2f3b727-b263-47d2-8a05-9c9f96fc1879 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:09.634826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2f3b727-b263-47d2-8a05-9c9f96fc1879 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.204444 May 26 12:55:09.635395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 383/789] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:09 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:09.653962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9091aea-4e37-4164-83ed-7af4689c9b4b tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "DELETE /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 204 len: 0 microversion: 2.1 time: 0.342893 May 26 12:55:09.654573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 407/790] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:55:09 2022] DELETE /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:55:09.664149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56f45de9-be61-41da-9f96-3556f5617ae7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:09.664883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56f45de9-be61-41da-9f96-3556f5617ae7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:09.668155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:09.671862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56f45de9-be61-41da-9f96-3556f5617ae7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.672326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56f45de9-be61-41da-9f96-3556f5617ae7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.673130 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56f45de9-be61-41da-9f96-3556f5617ae7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.673607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56f45de9-be61-41da-9f96-3556f5617ae7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.807004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56f45de9-be61-41da-9f96-3556f5617ae7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:09.814482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56f45de9-be61-41da-9f96-3556f5617ae7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1555 microversion: 2.1 time: 0.155208 May 26 12:55:09.815082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 384/791] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:09 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:10.253596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:10.254800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:10.260866 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.261320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:10.262087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.262551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:10.276722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] HTTP exception thrown: Instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec could not be found. May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Request method failure captured: May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec HTTP/1.1 May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvtkij4vGeBs7o_ED6e20XDMM79LFEkKwE8zRDpvN-e3EokvsRt-JGUUN4Oo94FKBMSuwxb2TwC31iolTdyP5G4mlFFfHCkb5zEc8xpa6Jvr0JXGOIAg35z_iMaus7NIylOEpTQw4UMLS4Hqw6q9SWL-MOnMbMad1TU8wvSpoQUoY May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:55:10.278395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: e24e8e8d0b8042bfb7ee7881aa8a16c1 May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec could not be found. May 26 12:55:10.279993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec'} May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec could not be found. May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:10.282258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec could not be found. May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec could not be found. May 26 12:55:10.284269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:10.286215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Returning 404 to user: Instance 1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:10.286215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f287df54-9c11-4719-a7a2-bfc44b9b0629 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec" status: 404 len: 111 microversion: 2.1 time: 0.030775 May 26 12:55:10.286215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 408/792] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:10 2022] GET /compute/v2.1/servers/1b1d6a3d-9e9d-4d01-9ed9-01680c8299ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:55:10.289391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-984e38e4-0d29-419e-a194-f7d6f673a384 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '.version_select at 0x7f498c1aedc0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:10.371842 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-984e38e4-0d29-419e-a194-f7d6f673a384 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656851192" status: 202 len: 0 microversion: 2.1 time: 0.086938 May 26 12:55:10.375281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 385/793] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 26 12:55:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656851192 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:10.652695 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-227c0212-6ea1-46f9-b207-d6a4f02ae705 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:10.659320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-227c0212-6ea1-46f9-b207-d6a4f02ae705 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:10.665780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-227c0212-6ea1-46f9-b207-d6a4f02ae705 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.666465 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-227c0212-6ea1-46f9-b207-d6a4f02ae705 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:10.667483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-227c0212-6ea1-46f9-b207-d6a4f02ae705 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.668207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-227c0212-6ea1-46f9-b207-d6a4f02ae705 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:10.833464 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-98fb5120-0f7b-4aad-94f6-da8827108d5e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:10.834080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-98fb5120-0f7b-4aad-94f6-da8827108d5e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:10.845235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98fb5120-0f7b-4aad-94f6-da8827108d5e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.848799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98fb5120-0f7b-4aad-94f6-da8827108d5e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:10.851714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98fb5120-0f7b-4aad-94f6-da8827108d5e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.852350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98fb5120-0f7b-4aad-94f6-da8827108d5e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:11.133866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-98fb5120-0f7b-4aad-94f6-da8827108d5e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:11.144169 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-98fb5120-0f7b-4aad-94f6-da8827108d5e tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1555 microversion: 2.1 time: 0.315161 May 26 12:55:11.148275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 386/794] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:10 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1555 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:11.326828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-227c0212-6ea1-46f9-b207-d6a4f02ae705 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:11.336857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-227c0212-6ea1-46f9-b207-d6a4f02ae705 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.688213 May 26 12:55:11.337547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 409/795] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:10 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:12.132945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-998459306", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83127c00-08da-4fe7-8cef-eaed67104a46"}], "security_groups": [{"name": "tempest-securitygroup--1602443220"}], "key_name": "tempest-keypair-461462108", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:12.164539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c331ba5e-aee3-48df-b4d1-3f4f07486302 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:12.165869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c331ba5e-aee3-48df-b4d1-3f4f07486302 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:12.194488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c331ba5e-aee3-48df-b4d1-3f4f07486302 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.195368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c331ba5e-aee3-48df-b4d1-3f4f07486302 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.196238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c331ba5e-aee3-48df-b4d1-3f4f07486302 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.196688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c331ba5e-aee3-48df-b4d1-3f4f07486302 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.247628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] validate_networks() for [('83127c00-08da-4fe7-8cef-eaed67104a46', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:55:12.398038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c331ba5e-aee3-48df-b4d1-3f4f07486302 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:12.406264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c331ba5e-aee3-48df-b4d1-3f4f07486302 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1555 microversion: 2.1 time: 0.245976 May 26 12:55:12.406908 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 410/796] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:12 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:12.412221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-982d2a9c-9d6a-43c1-b232-29ea32c14e28 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:12.413049 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-982d2a9c-9d6a-43c1-b232-29ea32c14e28 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:12.419853 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-982d2a9c-9d6a-43c1-b232-29ea32c14e28 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.422433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-982d2a9c-9d6a-43c1-b232-29ea32c14e28 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.422433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-982d2a9c-9d6a-43c1-b232-29ea32c14e28 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.422433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-982d2a9c-9d6a-43c1-b232-29ea32c14e28 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.647666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:55:12.647874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-982d2a9c-9d6a-43c1-b232-29ea32c14e28 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:12.648113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:55:12.648585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:55:12.648993 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:55:12.649449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:55:12.656168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-982d2a9c-9d6a-43c1-b232-29ea32c14e28 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.248137 May 26 12:55:12.656731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 411/797] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:12 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:12.658124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.658599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.659560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.660004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.662291 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-5359c011-03e7-45ac-b922-810c8d29463a req-8335ad7c-cb96-4389-a88b-f0a3553c0f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e5b57b-24ad-473d-9c97-b337fbac6fdc", "name": "network-vif-deleted", "tag": "fc34668d-8f02-4867-b0e0-992d7f4dad7d"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:12.666564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:12.671853 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5359c011-03e7-45ac-b922-810c8d29463a req-8335ad7c-cb96-4389-a88b-f0a3553c0f6a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.677255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5359c011-03e7-45ac-b922-810c8d29463a req-8335ad7c-cb96-4389-a88b-f0a3553c0f6a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.677846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Getting quotas for project 60655349037a415e8d26e794e9d3cc79. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:55:12.682164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Getting quotas for user 34cd6fbd9b654e31a387acc25ee94d44 and project 60655349037a415e8d26e794e9d3cc79. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:55:12.684449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-5359c011-03e7-45ac-b922-810c8d29463a req-8335ad7c-cb96-4389-a88b-f0a3553c0f6a service nova] Creating event network-vif-deleted:fc34668d-8f02-4867-b0e0-992d7f4dad7d for instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc on hv-cinder-81514 May 26 12:55:12.689310 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-5359c011-03e7-45ac-b922-810c8d29463a req-8335ad7c-cb96-4389-a88b-f0a3553c0f6a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 May 26 12:55:12.689904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 412/798] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:12.694107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:55:12.696403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:55:12.829481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f63b2c28-a774-412a-97a0-da90f1631a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.701838 May 26 12:55:12.830505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 387/799] 10.222.0.60 () {62 vars in 1187 bytes} [Thu May 26 12:55:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 12:55:12.845304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf57edbf-215a-4c78-a8da-1c7f6be01040 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:12.846208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf57edbf-215a-4c78-a8da-1c7f6be01040 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:12.922595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf57edbf-215a-4c78-a8da-1c7f6be01040 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:12.932194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf57edbf-215a-4c78-a8da-1c7f6be01040 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:12.933757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf57edbf-215a-4c78-a8da-1c7f6be01040 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:12.935006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf57edbf-215a-4c78-a8da-1c7f6be01040 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1280 microversion: 2.20 time: 0.098173 May 26 12:55:12.935637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 413/800] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:12 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1280 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:55:13.204523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-0ad702ca-dc73-4c89-b95d-8524d184c1f5 req-900125d1-a790-4014-95fa-3e8aa8f8a9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a12be-8748-41ab-a6a4-17d666ea34d0", "name": "network-vif-plugged", "status": "completed", "tag": "e5d66805-9eb5-4134-a395-25cf61316cc2"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:13.214171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0ad702ca-dc73-4c89-b95d-8524d184c1f5 req-900125d1-a790-4014-95fa-3e8aa8f8a9aa service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.219179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0ad702ca-dc73-4c89-b95d-8524d184c1f5 req-900125d1-a790-4014-95fa-3e8aa8f8a9aa service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.225634 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-0ad702ca-dc73-4c89-b95d-8524d184c1f5 req-900125d1-a790-4014-95fa-3e8aa8f8a9aa service nova] Creating event network-vif-plugged:e5d66805-9eb5-4134-a395-25cf61316cc2 for instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 on hv-cinder-81514 May 26 12:55:13.230913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-0ad702ca-dc73-4c89-b95d-8524d184c1f5 req-900125d1-a790-4014-95fa-3e8aa8f8a9aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030714 May 26 12:55:13.231625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 388/801] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:13.424226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:13.424878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:13.433322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.433794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.434563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.435009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.467775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.468229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.468683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lazy-loading 'fault' on Instance uuid 43e5b57b-24ad-473d-9c97-b337fbac6fdc {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:13.515618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db52c21a4c58422fa7ccad6232fc8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7059688f7a24761b61e51820c78a2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:13.526611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e25e4b7-7af4-4804-bfcf-e37bba6aed6c tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 200 len: 1348 microversion: 2.1 time: 0.106300 May 26 12:55:13.527338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 414/802] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:13 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:13.776783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-27454915-8702-4551-b34f-28d5b81b283e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:13.777573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-27454915-8702-4551-b34f-28d5b81b283e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:13.784860 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27454915-8702-4551-b34f-28d5b81b283e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.786002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27454915-8702-4551-b34f-28d5b81b283e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.786899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27454915-8702-4551-b34f-28d5b81b283e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.787347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27454915-8702-4551-b34f-28d5b81b283e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.925358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27454915-8702-4551-b34f-28d5b81b283e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:13.936708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-27454915-8702-4551-b34f-28d5b81b283e tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.264486 May 26 12:55:13.936708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 389/803] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:13 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:13.953159 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:13.953798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:13.960267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.960738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.961491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.961928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.023084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:14.030938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:14.032434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:14.033531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e2b849f-7a2c-4911-bb33-b2efa9981a6a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1284 microversion: 2.20 time: 0.084346 May 26 12:55:14.034089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 415/804] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:13 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:55:14.168024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-86118384-68d4-4270-85ac-e4b361187f32 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.168558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-86118384-68d4-4270-85ac-e4b361187f32 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:14.174461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86118384-68d4-4270-85ac-e4b361187f32 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.174943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86118384-68d4-4270-85ac-e4b361187f32 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.175735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86118384-68d4-4270-85ac-e4b361187f32 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.176458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86118384-68d4-4270-85ac-e4b361187f32 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.201562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-86118384-68d4-4270-85ac-e4b361187f32 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:55:14.490700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-86118384-68d4-4270-85ac-e4b361187f32 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 204 len: 0 microversion: 2.1 time: 0.326044 May 26 12:55:14.491359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 390/805] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:55:14 2022] DELETE /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:55:14.499179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2447f967-b883-415b-9ee3-8a8619aee2ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.499797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2447f967-b883-415b-9ee3-8a8619aee2ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:14.507699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2447f967-b883-415b-9ee3-8a8619aee2ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.508159 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2447f967-b883-415b-9ee3-8a8619aee2ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.509114 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2447f967-b883-415b-9ee3-8a8619aee2ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.509745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2447f967-b883-415b-9ee3-8a8619aee2ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.545142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.546280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] [instance: 43e5b57b-24ad-473d-9c97-b337fbac6fdc] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:14.555930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.556236 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.557295 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.557974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.574094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] HTTP exception thrown: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc could not be found. May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Request method failure captured: May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc HTTP/1.1 May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3eNo_FdeUGENB648TJ27EN_qjFMin-XxvYjjInT1T4LlUZX4nGvrWXdoGTohqnkFZWh_oX8gSdgxuw_q8bnkLVXUfUd0FjFVZB2lIjOdc-BFHljB-KZuWWGMGGI6T9zBvr3IUFykRnFADP177Ka66Vdu_tnf_WTPT9MFYHJd8VS6eU May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: b7059688f7a24761b61e51820c78a2ab May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-2002535439 May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:55:14.575853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b7059688f7a24761b61e51820c78a2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b7059688f7a24761b61e51820c78a2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b7059688f7a24761b61e51820c78a2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b7059688f7a24761b61e51820c78a2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-2002535439 May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: b7059688f7a24761b61e51820c78a2ab May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2002535439 May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-2002535439-project May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: db52c21a4c58422fa7ccad6232fc8f21 May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-2002535439-project May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc could not be found. May 26 12:55:14.577118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '43e5b57b-24ad-473d-9c97-b337fbac6fdc'} May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc could not be found. May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:14.577853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc could not be found. May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc could not be found. May 26 12:55:14.579558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:14.580585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Returning 404 to user: Instance 43e5b57b-24ad-473d-9c97-b337fbac6fdc could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:14.580585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e3751f1-b743-4117-99dd-a9413befc9a7 tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc" status: 404 len: 111 microversion: 2.1 time: 0.036734 May 26 12:55:14.580585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 391/806] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:14 2022] GET /compute/v2.1/servers/43e5b57b-24ad-473d-9c97-b337fbac6fdc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:55:14.587326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-129ea020-e88e-4c53-9eb2-7016473afbcc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] Calling method '.version_select at 0x7f498c034700>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.656644 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2447f967-b883-415b-9ee3-8a8619aee2ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:14.665695 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2447f967-b883-415b-9ee3-8a8619aee2ed tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1508 microversion: 2.1 time: 0.170326 May 26 12:55:14.666272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 416/807] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:14 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:14.672230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-129ea020-e88e-4c53-9eb2-7016473afbcc tempest-TestMinimumBasicScenario-2002535439 tempest-TestMinimumBasicScenario-2002535439-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1021647175" status: 202 len: 0 microversion: 2.1 time: 0.089679 May 26 12:55:14.672809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 392/808] 10.222.0.60 () {58 vars in 1271 bytes} [Thu May 26 12:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1021647175 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:14.951883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ede0f58-a157-4bc3-8ba1-3afc53cc7fea tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.952256 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ede0f58-a157-4bc3-8ba1-3afc53cc7fea tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:14.958990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ede0f58-a157-4bc3-8ba1-3afc53cc7fea tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.959372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ede0f58-a157-4bc3-8ba1-3afc53cc7fea tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.960320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ede0f58-a157-4bc3-8ba1-3afc53cc7fea tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.960761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ede0f58-a157-4bc3-8ba1-3afc53cc7fea tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.052602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:15.057220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:15.059624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.060076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.060845 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.061283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.100657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ede0f58-a157-4bc3-8ba1-3afc53cc7fea tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:15.108402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ede0f58-a157-4bc3-8ba1-3afc53cc7fea tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1577 microversion: 2.1 time: 0.160858 May 26 12:55:15.108978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 417/809] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:14 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:15.123706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:15.132947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:15.134454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:15.135588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f5b8660-f6fd-4f01-b9fd-5fb406c0ee6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1276 microversion: 2.20 time: 0.087234 May 26 12:55:15.136141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 393/810] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:15 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:55:15.683986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13e2a0dd-080c-448b-ad8c-9a77e17587c3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:15.684958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-13e2a0dd-080c-448b-ad8c-9a77e17587c3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:15.694949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13e2a0dd-080c-448b-ad8c-9a77e17587c3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.695683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13e2a0dd-080c-448b-ad8c-9a77e17587c3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.696973 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13e2a0dd-080c-448b-ad8c-9a77e17587c3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.697700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13e2a0dd-080c-448b-ad8c-9a77e17587c3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.834303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-13e2a0dd-080c-448b-ad8c-9a77e17587c3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:15.845681 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-13e2a0dd-080c-448b-ad8c-9a77e17587c3 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1508 microversion: 2.1 time: 0.166343 May 26 12:55:15.846274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 418/811] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:15 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:16.125523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b7c1ed1e-fca5-4697-8b1d-1e2901be75aa tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:16.132000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b7c1ed1e-fca5-4697-8b1d-1e2901be75aa tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:16.135504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c1ed1e-fca5-4697-8b1d-1e2901be75aa tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.135962 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c1ed1e-fca5-4697-8b1d-1e2901be75aa tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.136748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c1ed1e-fca5-4697-8b1d-1e2901be75aa tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.137193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c1ed1e-fca5-4697-8b1d-1e2901be75aa tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.154677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:16.155295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:16.166651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.166651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.166651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.166651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.253099 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:16.268662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:16.270769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:16.272011 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-edbf7ff4-df77-4e18-a55c-12e0d656402c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1332 microversion: 2.20 time: 0.121244 May 26 12:55:16.272564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 419/812] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:16 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:55:16.674273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7c1ed1e-fca5-4697-8b1d-1e2901be75aa tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:16.682702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b7c1ed1e-fca5-4697-8b1d-1e2901be75aa tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1564 microversion: 2.1 time: 0.561162 May 26 12:55:16.683400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 394/813] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:16 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1564 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:16.797149 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-44e5ebf6-a758-49d4-ae6c-06e2209733d3 req-7072535a-2711-49cf-ac89-b70c6b395b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0427d82f-3f18-4102-963b-6eab4c3a7bd5", "name": "network-vif-deleted", "tag": "efe1db4b-2d32-49d2-9494-afad4976ae83"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:16.812763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-44e5ebf6-a758-49d4-ae6c-06e2209733d3 req-7072535a-2711-49cf-ac89-b70c6b395b05 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.814283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-44e5ebf6-a758-49d4-ae6c-06e2209733d3 req-7072535a-2711-49cf-ac89-b70c6b395b05 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.828451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-44e5ebf6-a758-49d4-ae6c-06e2209733d3 req-7072535a-2711-49cf-ac89-b70c6b395b05 service nova] Creating event network-vif-deleted:efe1db4b-2d32-49d2-9494-afad4976ae83 for instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 on hv-cinder-81514 May 26 12:55:16.834953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-44e5ebf6-a758-49d4-ae6c-06e2209733d3 req-7072535a-2711-49cf-ac89-b70c6b395b05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041495 May 26 12:55:16.836209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 420/814] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:16.865234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-924211dc-f3b4-4a30-b40f-ee3dc30f220e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:16.866558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-924211dc-f3b4-4a30-b40f-ee3dc30f220e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:16.878108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-924211dc-f3b4-4a30-b40f-ee3dc30f220e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.878968 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-924211dc-f3b4-4a30-b40f-ee3dc30f220e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.880034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-924211dc-f3b4-4a30-b40f-ee3dc30f220e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.880569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-924211dc-f3b4-4a30-b40f-ee3dc30f220e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:17.008678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-924211dc-f3b4-4a30-b40f-ee3dc30f220e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:17.017017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-924211dc-f3b4-4a30-b40f-ee3dc30f220e tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 200 len: 1466 microversion: 2.1 time: 0.156955 May 26 12:55:17.017607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 395/815] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:16 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:17.294163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:17.295282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:17.304372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:17.304980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:17.306387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:17.306877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:17.407795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:17.418412 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:17.420053 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:17.421824 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-83047b98-8c3b-4d0c-a87f-e9df4ecb3626 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1338 microversion: 2.20 time: 0.134113 May 26 12:55:17.422383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 421/816] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:17 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1338 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:55:18.044073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:18.045815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 0427d82f-3f18-4102-963b-6eab4c3a7bd5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:18.057985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.059772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.060795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.061336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.071126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:18.278764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] HTTP exception thrown: Instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 could not be found. May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Request method failure captured: May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 HTTP/1.1 May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvtkij4vGeBs7o_ED6e20XDMM79LFEkKwE8zRDpvN-e3EokvsRt-JGUUN4Oo94FKBMSuwxb2TwC31iolTdyP5G4mlFFfHCkb5zEc8xpa6Jvr0JXGOIAg35z_iMaus7NIylOEpTQw4UMLS4Hqw6q9SWL-MOnMbMad1TU8wvSpoQUoY May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:55:18.280341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: e24e8e8d0b8042bfb7ee7881aa8a16c1 May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 could not be found. May 26 12:55:18.281971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '0427d82f-3f18-4102-963b-6eab4c3a7bd5'} May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 could not be found. May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:18.282837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 could not be found. May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 could not be found. May 26 12:55:18.284212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:55:18.287704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Returning 404 to user: Instance 0427d82f-3f18-4102-963b-6eab4c3a7bd5 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:18.288578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7651288a-7e8e-435c-aa57-3d2c08bb5d28 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5" status: 404 len: 111 microversion: 2.1 time: 0.257393 May 26 12:55:18.289883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 396/817] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:18 2022] GET /compute/v2.1/servers/0427d82f-3f18-4102-963b-6eab4c3a7bd5 => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:55:18.298802 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0be93e32-3755-4e80-8118-5e9de684215d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:18.299370 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0be93e32-3755-4e80-8118-5e9de684215d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:18.306221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0be93e32-3755-4e80-8118-5e9de684215d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.306965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0be93e32-3755-4e80-8118-5e9de684215d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.307822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0be93e32-3755-4e80-8118-5e9de684215d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.308359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0be93e32-3755-4e80-8118-5e9de684215d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.338429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0be93e32-3755-4e80-8118-5e9de684215d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:55:18.440228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:18.440830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:18.448166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.448895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.449820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.450425 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.490626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:18.742439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:18.757134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:18.758423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0be93e32-3755-4e80-8118-5e9de684215d tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 204 len: 0 microversion: 2.1 time: 0.463921 May 26 12:55:18.759230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 422/818] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:55:18 2022] DELETE /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:55:18.763073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:18.765991 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2986478-770d-4e13-a742-e3c2c555ee0c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1406 microversion: 2.20 time: 0.329733 May 26 12:55:18.768496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dfdf9d2f-5f56-4f21-88ef-893caf766bb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:18.770330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dfdf9d2f-5f56-4f21-88ef-893caf766bb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:18.777498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 397/819] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:18 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:18.780898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfdf9d2f-5f56-4f21-88ef-893caf766bb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.781579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfdf9d2f-5f56-4f21-88ef-893caf766bb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.782379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfdf9d2f-5f56-4f21-88ef-893caf766bb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.782867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfdf9d2f-5f56-4f21-88ef-893caf766bb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:19.024619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dfdf9d2f-5f56-4f21-88ef-893caf766bb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:19.025588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-83b11aad-c0a3-4e46-8590-bcc9103f669a req-79948b90-fa84-4f6d-8646-41ac174b5fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdeafbfd-a134-4f97-a26a-f89140e94b94", "tag": "e02acdf1-82f4-4eaf-82b0-de617a5c93e4"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:19.036268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dfdf9d2f-5f56-4f21-88ef-893caf766bb7 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.269802 May 26 12:55:19.046468 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-83b11aad-c0a3-4e46-8590-bcc9103f669a req-79948b90-fa84-4f6d-8646-41ac174b5fe8 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:19.046468 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-83b11aad-c0a3-4e46-8590-bcc9103f669a req-79948b90-fa84-4f6d-8646-41ac174b5fe8 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:19.049863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 423/820] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:18 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:19.067963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-83b11aad-c0a3-4e46-8590-bcc9103f669a req-79948b90-fa84-4f6d-8646-41ac174b5fe8 service nova] Creating event network-changed:e02acdf1-82f4-4eaf-82b0-de617a5c93e4 for instance cdeafbfd-a134-4f97-a26a-f89140e94b94 on hv-cinder-81514 May 26 12:55:19.082249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-83b11aad-c0a3-4e46-8590-bcc9103f669a req-79948b90-fa84-4f6d-8646-41ac174b5fe8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061383 May 26 12:55:19.083291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 398/821] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:55:19.786303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:19.787182 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:19.794688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:19.795273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:19.796435 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:19.797016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:19.947024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:19.955183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:19.957405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:19.958572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0578c078-fe76-4983-91f9-5a5f49176502 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1406 microversion: 2.20 time: 0.177201 May 26 12:55:19.959154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 424/822] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:19 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:20.054539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dab47e77-bea1-462a-9bdb-7dbfe7522818 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:20.056991 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dab47e77-bea1-462a-9bdb-7dbfe7522818 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:20.066555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dab47e77-bea1-462a-9bdb-7dbfe7522818 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.068158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dab47e77-bea1-462a-9bdb-7dbfe7522818 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.068955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dab47e77-bea1-462a-9bdb-7dbfe7522818 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.069399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dab47e77-bea1-462a-9bdb-7dbfe7522818 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.280811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dab47e77-bea1-462a-9bdb-7dbfe7522818 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:20.289049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dab47e77-bea1-462a-9bdb-7dbfe7522818 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1523 microversion: 2.1 time: 0.238928 May 26 12:55:20.289619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 399/823] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:20 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:20.427908 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-33a1a1cb-9245-44e6-a810-40ceceed74bd req-c93a2eff-b308-4dae-9aca-799a487b2ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f291eb7-afa2-456e-8494-97b63e9f2144", "name": "network-vif-deleted", "tag": "9b84c175-e682-4c14-95ef-351de4245754"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:20.436818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-33a1a1cb-9245-44e6-a810-40ceceed74bd req-c93a2eff-b308-4dae-9aca-799a487b2ae5 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.437266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-33a1a1cb-9245-44e6-a810-40ceceed74bd req-c93a2eff-b308-4dae-9aca-799a487b2ae5 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.449204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-33a1a1cb-9245-44e6-a810-40ceceed74bd req-c93a2eff-b308-4dae-9aca-799a487b2ae5 service nova] Creating event network-vif-deleted:9b84c175-e682-4c14-95ef-351de4245754 for instance 9f291eb7-afa2-456e-8494-97b63e9f2144 on hv-cinder-81514 May 26 12:55:20.454512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-33a1a1cb-9245-44e6-a810-40ceceed74bd req-c93a2eff-b308-4dae-9aca-799a487b2ae5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030352 May 26 12:55:20.455135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 425/824] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:20.981480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:20.982096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:20.988762 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.989217 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.989990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.990425 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:21.159151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:21.167461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:21.168906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:21.170015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5824d97-ba16-4a53-9c4e-bb19e0bc3b80 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1406 microversion: 2.20 time: 0.193851 May 26 12:55:21.170584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 400/825] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:20 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:21.308406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-38ff18c7-1d24-41f0-9640-769c2b9771bc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:21.309102 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-38ff18c7-1d24-41f0-9640-769c2b9771bc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:21.315536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38ff18c7-1d24-41f0-9640-769c2b9771bc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:21.316029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38ff18c7-1d24-41f0-9640-769c2b9771bc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:21.317680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38ff18c7-1d24-41f0-9640-769c2b9771bc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:21.318128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38ff18c7-1d24-41f0-9640-769c2b9771bc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:21.409228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38ff18c7-1d24-41f0-9640-769c2b9771bc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:21.417533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-38ff18c7-1d24-41f0-9640-769c2b9771bc tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1481 microversion: 2.1 time: 0.113835 May 26 12:55:21.418113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 426/826] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:21 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1481 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:22.188512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:22.189115 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:22.196327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:22.196805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:22.197570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:22.198005 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:22.329008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:22.337849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:22.339400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:22.340560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf6b5520-7365-49ca-8095-548df61ec511 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1406 microversion: 2.20 time: 0.155948 May 26 12:55:22.341159 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 401/827] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:22 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:22.435175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09cb4f6a-054e-4ac1-ac55-1756dce282e1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:22.435815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09cb4f6a-054e-4ac1-ac55-1756dce282e1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:22.442839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09cb4f6a-054e-4ac1-ac55-1756dce282e1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:22.443376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09cb4f6a-054e-4ac1-ac55-1756dce282e1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:22.444229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09cb4f6a-054e-4ac1-ac55-1756dce282e1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:22.444753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09cb4f6a-054e-4ac1-ac55-1756dce282e1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:22.539546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-09cb4f6a-054e-4ac1-ac55-1756dce282e1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e8e8d0b8042bfb7ee7881aa8a16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c0c747833441bda0a5f8d62de53cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:22.549033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09cb4f6a-054e-4ac1-ac55-1756dce282e1 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 200 len: 1481 microversion: 2.1 time: 0.117205 May 26 12:55:22.549440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 427/828] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:22 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 1481 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:23.360639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:23.361234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:23.364342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:23.365090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=10 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:23.371279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.371757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.372575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.373331 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.559154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:23.568820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:23.569598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] [instance: 9f291eb7-afa2-456e-8494-97b63e9f2144] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:23.569722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:23.571317 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:23.572843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2948f12d-a093-4c53-8275-25a5300910f3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1406 microversion: 2.20 time: 0.216879 May 26 12:55:23.573946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 402/829] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:23 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:23.576101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:23.579763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.580583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.582055 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:23.583005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.617904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] HTTP exception thrown: Instance 9f291eb7-afa2-456e-8494-97b63e9f2144 could not be found. May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Request method failure captured: May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 HTTP/1.1 May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvtkij4vGeBs7o_ED6e20XDMM79LFEkKwE8zRDpvN-e3EokvsRt-JGUUN4Oo94FKBMSuwxb2TwC31iolTdyP5G4mlFFfHCkb5zEc8xpa6Jvr0JXGOIAg35z_iMaus7NIylOEpTQw4UMLS4Hqw6q9SWL-MOnMbMad1TU8wvSpoQUoY May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:55:23.620328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c0c747833441bda0a5f8d62de53cd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 98c0c747833441bda0a5f8d62de53cd3 May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-897996070 May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: e24e8e8d0b8042bfb7ee7881aa8a16c1 May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-897996070-project May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 9f291eb7-afa2-456e-8494-97b63e9f2144 could not be found. May 26 12:55:23.621988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '9f291eb7-afa2-456e-8494-97b63e9f2144'} May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f291eb7-afa2-456e-8494-97b63e9f2144 could not be found. May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:23.624147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f291eb7-afa2-456e-8494-97b63e9f2144 could not be found. May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f291eb7-afa2-456e-8494-97b63e9f2144 could not be found. May 26 12:55:23.626079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:23.627568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] Returning 404 to user: Instance 9f291eb7-afa2-456e-8494-97b63e9f2144 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:23.627568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2cc2ba1b-17de-43c0-9b84-3749c9087407 tempest-ServerRescueNegativeTestJSON-897996070 tempest-ServerRescueNegativeTestJSON-897996070-project] 10.222.0.60 "GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144" status: 404 len: 111 microversion: 2.1 time: 0.058221 May 26 12:55:23.627568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 428/830] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:55:23 2022] GET /compute/v2.1/servers/9f291eb7-afa2-456e-8494-97b63e9f2144 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:55:24.592320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:24.600599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:24.600599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:24.601073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:24.601859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:24.602299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:24.977749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:24.991171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:24.993090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:24.994251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba7f1611-8949-4170-8128-0e579d03f420 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1406 microversion: 2.20 time: 0.406050 May 26 12:55:25.005682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 403/831] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:24 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:25.599198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-ef034190-7874-49a4-a666-b76656803a2f req-ebf9f4a1-87b9-4c10-a57a-9b6b5f1a761c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeafbfd-a134-4f97-a26a-f89140e94b94", "name": "network-vif-plugged", "status": "completed", "tag": "e02acdf1-82f4-4eaf-82b0-de617a5c93e4"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:25.609371 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ef034190-7874-49a4-a666-b76656803a2f req-ebf9f4a1-87b9-4c10-a57a-9b6b5f1a761c service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:25.609816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ef034190-7874-49a4-a666-b76656803a2f req-ebf9f4a1-87b9-4c10-a57a-9b6b5f1a761c service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:25.622076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-ef034190-7874-49a4-a666-b76656803a2f req-ebf9f4a1-87b9-4c10-a57a-9b6b5f1a761c service nova] Creating event network-vif-plugged:e02acdf1-82f4-4eaf-82b0-de617a5c93e4 for instance cdeafbfd-a134-4f97-a26a-f89140e94b94 on hv-cinder-81514 May 26 12:55:25.627371 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-ef034190-7874-49a4-a666-b76656803a2f req-ebf9f4a1-87b9-4c10-a57a-9b6b5f1a761c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032929 May 26 12:55:25.627960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 429/832] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:26.012735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:26.013982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:26.021826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:26.022549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:26.023503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:26.024095 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:26.201329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:26.209986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:26.212189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:26.213632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d8eaf43-4484-488a-849f-a760fc0f2d59 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1406 microversion: 2.20 time: 0.204755 May 26 12:55:26.214516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 404/833] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:26 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:27.233068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:27.233756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:27.240771 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:27.241222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:27.241991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:27.242427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:27.432442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:27.438030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:27.444573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:27.447406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2d0fe58e-fbaf-40b0-8ca9-d42cfde485da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1406 microversion: 2.20 time: 0.217611 May 26 12:55:27.466703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 430/834] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:27 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:28.465705 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:28.466336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:28.474308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:28.477947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:28.477947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:28.477947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:28.621520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:28.631386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:28.632909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:28.634147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b281b207-fc77-426b-a1fd-4f41d761441f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1598 microversion: 2.20 time: 0.172566 May 26 12:55:28.634742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 405/835] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:55:28 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:55:28.653182 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6aa09b3-08cc-4bbf-a384-d97afce383c7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:28.653911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6aa09b3-08cc-4bbf-a384-d97afce383c7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:28.660913 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6aa09b3-08cc-4bbf-a384-d97afce383c7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:28.661369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6aa09b3-08cc-4bbf-a384-d97afce383c7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:28.662142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6aa09b3-08cc-4bbf-a384-d97afce383c7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:28.662604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6aa09b3-08cc-4bbf-a384-d97afce383c7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:28.742420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6aa09b3-08cc-4bbf-a384-d97afce383c7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093189 May 26 12:55:28.743050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 431/836] 10.222.0.60 () {60 vars in 1315 bytes} [Thu May 26 12:55:28 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:55:30.026648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-37c24b13-9322-4880-b3c8-aa73add12f4f req-bdb15b4f-092c-49dc-b4b9-cfbbc00c63bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdeafbfd-a134-4f97-a26a-f89140e94b94", "tag": "e02acdf1-82f4-4eaf-82b0-de617a5c93e4"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:30.039054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-37c24b13-9322-4880-b3c8-aa73add12f4f req-bdb15b4f-092c-49dc-b4b9-cfbbc00c63bd service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:30.039509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-37c24b13-9322-4880-b3c8-aa73add12f4f req-bdb15b4f-092c-49dc-b4b9-cfbbc00c63bd service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:30.051585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-37c24b13-9322-4880-b3c8-aa73add12f4f req-bdb15b4f-092c-49dc-b4b9-cfbbc00c63bd service nova] Creating event network-changed:e02acdf1-82f4-4eaf-82b0-de617a5c93e4 for instance cdeafbfd-a134-4f97-a26a-f89140e94b94 on hv-cinder-81514 May 26 12:55:30.062026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-37c24b13-9322-4880-b3c8-aa73add12f4f req-bdb15b4f-092c-49dc-b4b9-cfbbc00c63bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034626 May 26 12:55:30.062026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 406/837] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:46.507637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:46.508485 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:46.512318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-619ee770-1644-4f58-b3f5-2f455474dc96 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:46.512812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-619ee770-1644-4f58-b3f5-2f455474dc96 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:46.518795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-619ee770-1644-4f58-b3f5-2f455474dc96 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:46.519243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-619ee770-1644-4f58-b3f5-2f455474dc96 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:46.520714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-619ee770-1644-4f58-b3f5-2f455474dc96 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:46.521154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-619ee770-1644-4f58-b3f5-2f455474dc96 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:46.551825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-619ee770-1644-4f58-b3f5-2f455474dc96 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/ips" status: 200 len: 151 microversion: 2.1 time: 0.040605 May 26 12:55:46.551825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 432/838] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 12:55:46 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:49.262020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:49.263135 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=52 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:49.267381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e54f686-68b2-4f36-93cb-55211d302ccf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3311af28-6854-4f24-ba02-54a4d80fbdba"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:49.268524 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e54f686-68b2-4f36-93cb-55211d302ccf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:49.275453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e54f686-68b2-4f36-93cb-55211d302ccf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:49.275910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e54f686-68b2-4f36-93cb-55211d302ccf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:49.276682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e54f686-68b2-4f36-93cb-55211d302ccf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:49.277126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e54f686-68b2-4f36-93cb-55211d302ccf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:50.131841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e54f686-68b2-4f36-93cb-55211d302ccf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871055 May 26 12:55:50.132499 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 407/839] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:55:49 2022] POST /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:58.815073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3311af28-6854-4f24-ba02-54a4d80fbdba"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:58.816170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:58.823760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:58.828328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:58.828328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:58.828328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:58.906038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Invalid volume: volume 3311af28-6854-4f24-ba02-54a4d80fbdba is already attached to instances: 084c31a2-f433-4477-8388-749a59d8b900 May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: POST /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments HTTP/1.1 May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 74 May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:55:58.908143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {"volumeAttachment": {"volumeId": "3311af28-6854-4f24-ba02-54a4d80fbdba"}} May 26 12:55:58.909898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Invalid volume: volume 3311af28-6854-4f24-ba02-54a4d80fbdba is already attached to instances: 084c31a2-f433-4477-8388-749a59d8b900 May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '084c31a2-f433-4477-8388-749a59d8b900', 'body': {'volumeAttachment': {'volumeId': '3311af28-6854-4f24-ba02-54a4d80fbdba'}}} May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3311af28-6854-4f24-ba02-54a4d80fbdba is already attached to instances: 084c31a2-f433-4477-8388-749a59d8b900 May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:58.910865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3311af28-6854-4f24-ba02-54a4d80fbdba is already attached to instances: 084c31a2-f433-4477-8388-749a59d8b900 May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:58.912309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:58.913996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:58.913996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:58.913996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:58.913996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3311af28-6854-4f24-ba02-54a4d80fbdba is already attached to instances: 084c31a2-f433-4477-8388-749a59d8b900 May 26 12:55:58.913996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:55:58.913996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 400 to user: Invalid volume: volume 3311af28-6854-4f24-ba02-54a4d80fbdba is already attached to instances: 084c31a2-f433-4477-8388-749a59d8b900 {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:58.913996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8f62e18-8ce6-4148-9742-d880bc9f5273 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099440 May 26 12:55:58.913996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 433/840] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:55:58 2022] POST /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:55:58.973343 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ae59413-bab8-4488-8aec-df749b3f269a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:58.973944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ae59413-bab8-4488-8aec-df749b3f269a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:58.981656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae59413-bab8-4488-8aec-df749b3f269a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:58.982363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae59413-bab8-4488-8aec-df749b3f269a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:58.983779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae59413-bab8-4488-8aec-df749b3f269a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:58.984222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae59413-bab8-4488-8aec-df749b3f269a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:59.070499 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-4ae59413-bab8-4488-8aec-df749b3f269a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lazy-loading 'services' on Instance uuid 084c31a2-f433-4477-8388-749a59d8b900 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:55:59.321157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ae59413-bab8-4488-8aec-df749b3f269a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments/3311af28-6854-4f24-ba02-54a4d80fbdba" status: 202 len: 0 microversion: 2.1 time: 0.352468 May 26 12:55:59.321664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 408/841] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 12:55:58 2022] DELETE /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments/3311af28-6854-4f24-ba02-54a4d80fbdba => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:59.330052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9018133a-2e1b-40f3-9e87-c225cc1b0621 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:59.331093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9018133a-2e1b-40f3-9e87-c225cc1b0621 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:59.338412 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9018133a-2e1b-40f3-9e87-c225cc1b0621 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:59.338900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9018133a-2e1b-40f3-9e87-c225cc1b0621 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:59.339671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9018133a-2e1b-40f3-9e87-c225cc1b0621 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:59.340127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9018133a-2e1b-40f3-9e87-c225cc1b0621 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:59.369622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9018133a-2e1b-40f3-9e87-c225cc1b0621 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043610 May 26 12:55:59.370173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 434/842] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:55:59 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:00.382748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-efbf3eb4-4f08-479c-8f08-a699e1a55dfa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:00.383810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-efbf3eb4-4f08-479c-8f08-a699e1a55dfa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:00.390045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efbf3eb4-4f08-479c-8f08-a699e1a55dfa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:00.390506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efbf3eb4-4f08-479c-8f08-a699e1a55dfa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:00.391300 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efbf3eb4-4f08-479c-8f08-a699e1a55dfa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:00.391744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efbf3eb4-4f08-479c-8f08-a699e1a55dfa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:00.420947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-efbf3eb4-4f08-479c-8f08-a699e1a55dfa tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 May 26 12:56:00.421496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 409/843] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:56:00 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:01.432460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-668a21a6-98c8-47c4-9400-ff3beb9d4aeb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:01.433389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-668a21a6-98c8-47c4-9400-ff3beb9d4aeb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:01.439665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-668a21a6-98c8-47c4-9400-ff3beb9d4aeb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:01.440136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-668a21a6-98c8-47c4-9400-ff3beb9d4aeb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:01.440907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-668a21a6-98c8-47c4-9400-ff3beb9d4aeb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:01.441339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-668a21a6-98c8-47c4-9400-ff3beb9d4aeb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:01.470161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-668a21a6-98c8-47c4-9400-ff3beb9d4aeb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041596 May 26 12:56:01.470737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 435/844] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:56:01 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:56:01.528408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e0196b6d-4874-4bd5-a102-760f686f59ac tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:01.528922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e0196b6d-4874-4bd5-a102-760f686f59ac tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:01.535270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0196b6d-4874-4bd5-a102-760f686f59ac tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:01.537091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0196b6d-4874-4bd5-a102-760f686f59ac tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:01.537091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0196b6d-4874-4bd5-a102-760f686f59ac tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:01.537091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0196b6d-4874-4bd5-a102-760f686f59ac tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:01.562803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e0196b6d-4874-4bd5-a102-760f686f59ac tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:56:01.926266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e0196b6d-4874-4bd5-a102-760f686f59ac tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 204 len: 0 microversion: 2.1 time: 0.401302 May 26 12:56:01.926918 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 410/845] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:56:01 2022] DELETE /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:56:01.936207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d7423d6-6e91-4d8b-b2ae-3815729fbd81 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:01.936207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d7423d6-6e91-4d8b-b2ae-3815729fbd81 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:01.941737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d7423d6-6e91-4d8b-b2ae-3815729fbd81 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:01.942225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d7423d6-6e91-4d8b-b2ae-3815729fbd81 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:01.943102 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d7423d6-6e91-4d8b-b2ae-3815729fbd81 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:01.943548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d7423d6-6e91-4d8b-b2ae-3815729fbd81 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:02.085511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d7423d6-6e91-4d8b-b2ae-3815729fbd81 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:02.093864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d7423d6-6e91-4d8b-b2ae-3815729fbd81 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1682 microversion: 2.1 time: 0.162541 May 26 12:56:02.094580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 436/846] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:01 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:03.111263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7a318c1c-068c-4715-8147-2d48371153a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:03.112270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7a318c1c-068c-4715-8147-2d48371153a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:03.119886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a318c1c-068c-4715-8147-2d48371153a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:03.120334 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a318c1c-068c-4715-8147-2d48371153a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:03.121101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a318c1c-068c-4715-8147-2d48371153a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:03.121533 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a318c1c-068c-4715-8147-2d48371153a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:03.253622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a318c1c-068c-4715-8147-2d48371153a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:03.261630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7a318c1c-068c-4715-8147-2d48371153a8 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1682 microversion: 2.1 time: 0.154631 May 26 12:56:03.262389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 411/847] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:03 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:04.279173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca6f3a83-c9b6-4189-98f0-99d14e092147 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:04.279796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca6f3a83-c9b6-4189-98f0-99d14e092147 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:04.287232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6f3a83-c9b6-4189-98f0-99d14e092147 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:04.287763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6f3a83-c9b6-4189-98f0-99d14e092147 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:04.288660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6f3a83-c9b6-4189-98f0-99d14e092147 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:04.289111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6f3a83-c9b6-4189-98f0-99d14e092147 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:04.435143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ca6f3a83-c9b6-4189-98f0-99d14e092147 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:04.443303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca6f3a83-c9b6-4189-98f0-99d14e092147 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1682 microversion: 2.1 time: 0.168063 May 26 12:56:04.453808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 437/848] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:04 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:05.151135 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-61c2191e-2533-448f-a048-94f2ac51ba4a req-0cb8d100-88c4-4ee4-bee0-6b9cfd52ee06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084c31a2-f433-4477-8388-749a59d8b900", "name": "network-vif-deleted", "tag": "bc9f078e-34df-406e-a07b-b8120022ff12"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:05.159847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-61c2191e-2533-448f-a048-94f2ac51ba4a req-0cb8d100-88c4-4ee4-bee0-6b9cfd52ee06 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:05.160289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-61c2191e-2533-448f-a048-94f2ac51ba4a req-0cb8d100-88c4-4ee4-bee0-6b9cfd52ee06 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:05.172045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-61c2191e-2533-448f-a048-94f2ac51ba4a req-0cb8d100-88c4-4ee4-bee0-6b9cfd52ee06 service nova] Creating event network-vif-deleted:bc9f078e-34df-406e-a07b-b8120022ff12 for instance 084c31a2-f433-4477-8388-749a59d8b900 on hv-cinder-81514 May 26 12:56:05.177136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-61c2191e-2533-448f-a048-94f2ac51ba4a req-0cb8d100-88c4-4ee4-bee0-6b9cfd52ee06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030473 May 26 12:56:05.177723 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 412/849] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:05.461281 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e284264-35ab-4749-8957-45d8c4a3a077 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:05.462030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e284264-35ab-4749-8957-45d8c4a3a077 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:05.469476 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e284264-35ab-4749-8957-45d8c4a3a077 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:05.469878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e284264-35ab-4749-8957-45d8c4a3a077 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:05.470686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e284264-35ab-4749-8957-45d8c4a3a077 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:05.471122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e284264-35ab-4749-8957-45d8c4a3a077 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:05.540796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e284264-35ab-4749-8957-45d8c4a3a077 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:05.548419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e284264-35ab-4749-8957-45d8c4a3a077 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1325 microversion: 2.1 time: 0.091040 May 26 12:56:05.549206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 438/850] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:05 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1325 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:06.567037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:06.567649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:06.574331 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.582513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.582513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.582513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.607895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.608379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.608834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lazy-loading 'fault' on Instance uuid 084c31a2-f433-4477-8388-749a59d8b900 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:56:06.650941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:06.657950 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8c4b4ac-60e3-4707-83ec-9ad4cf3bfbe2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 200 len: 1330 microversion: 2.1 time: 0.095310 May 26 12:56:06.658712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 413/851] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:06 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:07.676312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:07.676932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:07.684661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:07.685113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:07.685927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:07.686364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:07.701587 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 HTTP/1.1 May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:56:07.703180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:56:07.704785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '084c31a2-f433-4477-8388-749a59d8b900'} May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:56:07.705624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:56:07.706846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:56:07.707951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:56:07.707951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-673ea140-c7e4-4fa3-9b8b-d7ac1f298f51 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 404 len: 111 microversion: 2.1 time: 0.032323 May 26 12:56:07.707951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 439/852] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:07 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:56:07.714918 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ff44fc6-90c9-4d82-996a-3f82605e9541 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '.version_select at 0x7f498c09d550>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:07.791629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ff44fc6-90c9-4d82-996a-3f82605e9541 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753206291" status: 202 len: 0 microversion: 2.1 time: 0.081029 May 26 12:56:07.792131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 414/853] 10.222.0.60 () {58 vars in 1217 bytes} [Thu May 26 12:56:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753206291 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:56:08.569127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04abc7e5-5310-445f-a459-b3bb8227fb8b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: .version_select at 0x7f498c1aed30>, body: {"keypair": {"name": "tempest-keypair-306267947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHhZTrTEyGkyGqxVVyLxPjggchHmStIkN20AXOs2fPP+E50D8MhNJtGyOAeQp6dpmR1LapslNqbe8TBAJIN1ohc5+o55AaC50w02mP2ZhNyWHDt6UhehLXi044IAjhMxw=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:08.583440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-04abc7e5-5310-445f-a459-b3bb8227fb8b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:56:08.588625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-04abc7e5-5310-445f-a459-b3bb8227fb8b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for user 98a275f65a3544a5b073fbf1ee10034b and project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:56:08.671834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04abc7e5-5310-445f-a459-b3bb8227fb8b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106689 May 26 12:56:08.672429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 440/854] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 12:56:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:11.134236 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1663551993", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6687087-b2c6-4c92-a8ec-55292a7bb20d"}], "security_groups": [{"name": "tempest-securitygroup--689715320"}], "key_name": "tempest-keypair-306267947", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:11.244526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] validate_networks() for [('f6687087-b2c6-4c92-a8ec-55292a7bb20d', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:56:11.618388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:56:11.618852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:56:11.619331 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:56:11.619743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:56:11.620156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:56:11.629088 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:11.629582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:11.630380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:11.630876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:11.647899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:56:11.651735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Getting quotas for user 98a275f65a3544a5b073fbf1ee10034b and project cffce3a08ba34b79aadf8d0399aff80f. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:56:11.664494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:56:11.666770 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:56:11.833247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-653eb6b6-d630-466e-ab27-ea356db285b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704260 May 26 12:56:11.834135 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 415/855] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:56:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:56:11.844921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4bae17a-e1a2-4c17-909e-4e80cccd7370 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:11.845561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d4bae17a-e1a2-4c17-909e-4e80cccd7370 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:11.903522 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d4bae17a-e1a2-4c17-909e-4e80cccd7370 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:11.912096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d4bae17a-e1a2-4c17-909e-4e80cccd7370 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1241 microversion: 2.1 time: 0.071958 May 26 12:56:11.913263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 441/856] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:11 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:12.930744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6aff5b3e-a350-4e68-9155-d71c6d3e3966 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:12.931364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6aff5b3e-a350-4e68-9155-d71c6d3e3966 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:12.938065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6aff5b3e-a350-4e68-9155-d71c6d3e3966 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:12.938516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6aff5b3e-a350-4e68-9155-d71c6d3e3966 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:12.939337 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6aff5b3e-a350-4e68-9155-d71c6d3e3966 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:12.939776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6aff5b3e-a350-4e68-9155-d71c6d3e3966 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:13.001336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6aff5b3e-a350-4e68-9155-d71c6d3e3966 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:13.009730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6aff5b3e-a350-4e68-9155-d71c6d3e3966 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1245 microversion: 2.1 time: 0.084456 May 26 12:56:13.010282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 416/857] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:12 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:14.028047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df7e857c-03d7-4a72-9a07-b63dda6fa229 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:14.029433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df7e857c-03d7-4a72-9a07-b63dda6fa229 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:14.036369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df7e857c-03d7-4a72-9a07-b63dda6fa229 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:14.039831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df7e857c-03d7-4a72-9a07-b63dda6fa229 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:14.040667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df7e857c-03d7-4a72-9a07-b63dda6fa229 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:14.041117 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df7e857c-03d7-4a72-9a07-b63dda6fa229 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:14.113763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df7e857c-03d7-4a72-9a07-b63dda6fa229 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:14.123898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df7e857c-03d7-4a72-9a07-b63dda6fa229 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1301 microversion: 2.1 time: 0.099663 May 26 12:56:14.124925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 442/858] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:14 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:56:15.141872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3f724282-d36d-47b3-92c1-8558edd35487 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:15.142771 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3f724282-d36d-47b3-92c1-8558edd35487 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:15.151354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f724282-d36d-47b3-92c1-8558edd35487 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:15.151883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f724282-d36d-47b3-92c1-8558edd35487 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:15.152670 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f724282-d36d-47b3-92c1-8558edd35487 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:15.153113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f724282-d36d-47b3-92c1-8558edd35487 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:15.376990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f724282-d36d-47b3-92c1-8558edd35487 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:15.385367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f724282-d36d-47b3-92c1-8558edd35487 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.247905 May 26 12:56:15.385981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 417/859] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:15 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:16.082384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e7de5f9e-c7d4-4c63-bb9d-c3c6cf2ed9bf req-01095a5a-974f-4c82-ba4b-be0eeeabae3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb33834-7db2-4be4-9ae9-3185ded84ab8", "tag": "d3779a64-ca3f-4d23-89b4-aa2278bd5bdf"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:16.091606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e7de5f9e-c7d4-4c63-bb9d-c3c6cf2ed9bf req-01095a5a-974f-4c82-ba4b-be0eeeabae3f service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:16.092051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e7de5f9e-c7d4-4c63-bb9d-c3c6cf2ed9bf req-01095a5a-974f-4c82-ba4b-be0eeeabae3f service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:16.104295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e7de5f9e-c7d4-4c63-bb9d-c3c6cf2ed9bf req-01095a5a-974f-4c82-ba4b-be0eeeabae3f service nova] Creating event network-changed:d3779a64-ca3f-4d23-89b4-aa2278bd5bdf for instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 on hv-cinder-81514 May 26 12:56:16.109560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e7de5f9e-c7d4-4c63-bb9d-c3c6cf2ed9bf req-01095a5a-974f-4c82-ba4b-be0eeeabae3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031949 May 26 12:56:16.110447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 443/860] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:56:16.410377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-80f04142-0ae0-469b-afaf-0951da32617a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:16.411026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-80f04142-0ae0-469b-afaf-0951da32617a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:16.417531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80f04142-0ae0-469b-afaf-0951da32617a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:16.417990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80f04142-0ae0-469b-afaf-0951da32617a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:16.418811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80f04142-0ae0-469b-afaf-0951da32617a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:16.419257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80f04142-0ae0-469b-afaf-0951da32617a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:16.649659 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-80f04142-0ae0-469b-afaf-0951da32617a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:16.657191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-80f04142-0ae0-469b-afaf-0951da32617a tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.250822 May 26 12:56:16.657752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 418/861] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:16 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:17.677205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2703f4e-a0ba-4954-a50d-222ce4448320 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:17.678642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2703f4e-a0ba-4954-a50d-222ce4448320 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:17.685130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2703f4e-a0ba-4954-a50d-222ce4448320 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:17.685592 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2703f4e-a0ba-4954-a50d-222ce4448320 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:17.686363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2703f4e-a0ba-4954-a50d-222ce4448320 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:17.686825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2703f4e-a0ba-4954-a50d-222ce4448320 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:17.822282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2703f4e-a0ba-4954-a50d-222ce4448320 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:17.829715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2703f4e-a0ba-4954-a50d-222ce4448320 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.158404 May 26 12:56:17.830270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 444/862] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:17 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:18.846978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8eb16e39-3f70-4a2c-b566-b57a314364b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:18.847592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8eb16e39-3f70-4a2c-b566-b57a314364b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:18.854864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8eb16e39-3f70-4a2c-b566-b57a314364b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:18.855317 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8eb16e39-3f70-4a2c-b566-b57a314364b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:18.856179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8eb16e39-3f70-4a2c-b566-b57a314364b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:18.856621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8eb16e39-3f70-4a2c-b566-b57a314364b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:18.988751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8eb16e39-3f70-4a2c-b566-b57a314364b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:18.996416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8eb16e39-3f70-4a2c-b566-b57a314364b5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.153473 May 26 12:56:18.996972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 419/863] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:18 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:20.013162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4c3489bf-31a8-4ec0-bc3d-d647bf48f7d2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:20.013766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4c3489bf-31a8-4ec0-bc3d-d647bf48f7d2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:20.020303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c3489bf-31a8-4ec0-bc3d-d647bf48f7d2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:20.020752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c3489bf-31a8-4ec0-bc3d-d647bf48f7d2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:20.021564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c3489bf-31a8-4ec0-bc3d-d647bf48f7d2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:20.022016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c3489bf-31a8-4ec0-bc3d-d647bf48f7d2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:20.151134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c3489bf-31a8-4ec0-bc3d-d647bf48f7d2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:20.158486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4c3489bf-31a8-4ec0-bc3d-d647bf48f7d2 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.149186 May 26 12:56:20.159088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 445/864] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:20 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:21.175362 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-78b97952-dd8c-4e9d-9102-b13a7216590c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:21.175971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-78b97952-dd8c-4e9d-9102-b13a7216590c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:21.178369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:21.183157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78b97952-dd8c-4e9d-9102-b13a7216590c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:21.183600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78b97952-dd8c-4e9d-9102-b13a7216590c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:21.184367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78b97952-dd8c-4e9d-9102-b13a7216590c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:21.184798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78b97952-dd8c-4e9d-9102-b13a7216590c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:21.187320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:21.319042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78b97952-dd8c-4e9d-9102-b13a7216590c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:21.327515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-78b97952-dd8c-4e9d-9102-b13a7216590c tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.156073 May 26 12:56:21.328065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 420/865] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:21 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:22.346542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01d94143-8dcb-4c57-9c9f-b3307a4f5509 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:22.346542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01d94143-8dcb-4c57-9c9f-b3307a4f5509 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:22.348043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:22.353044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01d94143-8dcb-4c57-9c9f-b3307a4f5509 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:22.353491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01d94143-8dcb-4c57-9c9f-b3307a4f5509 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:22.354259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01d94143-8dcb-4c57-9c9f-b3307a4f5509 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:22.354861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01d94143-8dcb-4c57-9c9f-b3307a4f5509 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:22.486342 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01d94143-8dcb-4c57-9c9f-b3307a4f5509 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:22.494363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01d94143-8dcb-4c57-9c9f-b3307a4f5509 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.153344 May 26 12:56:22.494989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 446/866] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:22 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:23.511866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c54d530-5541-457a-82d6-3b8ee54a7b7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:23.512507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c54d530-5541-457a-82d6-3b8ee54a7b7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:23.515092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:23.515731 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:23.520753 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c54d530-5541-457a-82d6-3b8ee54a7b7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:23.526201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c54d530-5541-457a-82d6-3b8ee54a7b7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:23.526201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c54d530-5541-457a-82d6-3b8ee54a7b7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:23.526201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c54d530-5541-457a-82d6-3b8ee54a7b7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:23.661387 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c54d530-5541-457a-82d6-3b8ee54a7b7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:23.669136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c54d530-5541-457a-82d6-3b8ee54a7b7f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.161386 May 26 12:56:23.669752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 421/867] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:23 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:23.815054 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-f3008504-ff22-4b4d-a956-430457d043b3 req-69b7c3fd-0ddd-4774-bffe-c5e76866013d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb33834-7db2-4be4-9ae9-3185ded84ab8", "name": "network-vif-plugged", "status": "completed", "tag": "d3779a64-ca3f-4d23-89b4-aa2278bd5bdf"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:23.824268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f3008504-ff22-4b4d-a956-430457d043b3 req-69b7c3fd-0ddd-4774-bffe-c5e76866013d service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:23.824722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f3008504-ff22-4b4d-a956-430457d043b3 req-69b7c3fd-0ddd-4774-bffe-c5e76866013d service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:23.835488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-f3008504-ff22-4b4d-a956-430457d043b3 req-69b7c3fd-0ddd-4774-bffe-c5e76866013d service nova] Creating event network-vif-plugged:d3779a64-ca3f-4d23-89b4-aa2278bd5bdf for instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 on hv-cinder-81514 May 26 12:56:23.840505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-f3008504-ff22-4b4d-a956-430457d043b3 req-69b7c3fd-0ddd-4774-bffe-c5e76866013d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029200 May 26 12:56:23.841094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 447/868] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:24.687223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef374bb6-41d1-47b2-8a7d-d9790635060b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:24.687831 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef374bb6-41d1-47b2-8a7d-d9790635060b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:24.695103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef374bb6-41d1-47b2-8a7d-d9790635060b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:24.695554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef374bb6-41d1-47b2-8a7d-d9790635060b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:24.696314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef374bb6-41d1-47b2-8a7d-d9790635060b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:24.696750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef374bb6-41d1-47b2-8a7d-d9790635060b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:24.822386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ef374bb6-41d1-47b2-8a7d-d9790635060b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:24.829797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef374bb6-41d1-47b2-8a7d-d9790635060b tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.146912 May 26 12:56:24.830506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 422/869] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:24 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:25.848932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a872d93d-573c-471a-974c-c45fb9fda0d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:25.850245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a872d93d-573c-471a-974c-c45fb9fda0d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:25.856553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a872d93d-573c-471a-974c-c45fb9fda0d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:25.857008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a872d93d-573c-471a-974c-c45fb9fda0d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:25.857776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a872d93d-573c-471a-974c-c45fb9fda0d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:25.858215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a872d93d-573c-471a-974c-c45fb9fda0d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:25.994938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a872d93d-573c-471a-974c-c45fb9fda0d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:26.003207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a872d93d-573c-471a-974c-c45fb9fda0d0 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1366 microversion: 2.1 time: 0.159122 May 26 12:56:26.003778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 448/870] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:25 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:27.019666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-950ce091-7f83-4540-8215-1f8338126265 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:27.020314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-950ce091-7f83-4540-8215-1f8338126265 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:27.027635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-950ce091-7f83-4540-8215-1f8338126265 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:27.028090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-950ce091-7f83-4540-8215-1f8338126265 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:27.028863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-950ce091-7f83-4540-8215-1f8338126265 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:27.029306 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-950ce091-7f83-4540-8215-1f8338126265 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:27.157262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-950ce091-7f83-4540-8215-1f8338126265 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:27.164878 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-950ce091-7f83-4540-8215-1f8338126265 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1557 microversion: 2.1 time: 0.149102 May 26 12:56:27.165429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 423/871] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:27 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:27.180972 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87334fbc-826b-458b-9566-7de25be85be1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:27.181498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87334fbc-826b-458b-9566-7de25be85be1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:27.187972 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87334fbc-826b-458b-9566-7de25be85be1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:27.188431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87334fbc-826b-458b-9566-7de25be85be1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:27.189205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87334fbc-826b-458b-9566-7de25be85be1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:27.189651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87334fbc-826b-458b-9566-7de25be85be1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:27.264664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87334fbc-826b-458b-9566-7de25be85be1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087635 May 26 12:56:27.265263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 449/872] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 26 12:56:27 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:28.277388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-dc86e887-19f8-4023-b5a7-44ec647d99f5 req-bbab483d-8bba-45b5-9101-c6c9fe0fe648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb33834-7db2-4be4-9ae9-3185ded84ab8", "tag": "d3779a64-ca3f-4d23-89b4-aa2278bd5bdf"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:28.286185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-dc86e887-19f8-4023-b5a7-44ec647d99f5 req-bbab483d-8bba-45b5-9101-c6c9fe0fe648 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:28.287429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-dc86e887-19f8-4023-b5a7-44ec647d99f5 req-bbab483d-8bba-45b5-9101-c6c9fe0fe648 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:28.298795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-dc86e887-19f8-4023-b5a7-44ec647d99f5 req-bbab483d-8bba-45b5-9101-c6c9fe0fe648 service nova] Creating event network-changed:d3779a64-ca3f-4d23-89b4-aa2278bd5bdf for instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 on hv-cinder-81514 May 26 12:56:28.304116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-dc86e887-19f8-4023-b5a7-44ec647d99f5 req-bbab483d-8bba-45b5-9101-c6c9fe0fe648 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030428 May 26 12:56:28.304970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 424/873] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:45.963743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:45.964415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=80 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:45.968334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8865f578-e55d-4b64-9384-f2974a9e15da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:45.968830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8865f578-e55d-4b64-9384-f2974a9e15da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:45.975689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8865f578-e55d-4b64-9384-f2974a9e15da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:45.979091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8865f578-e55d-4b64-9384-f2974a9e15da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:45.979091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8865f578-e55d-4b64-9384-f2974a9e15da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:45.979091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8865f578-e55d-4b64-9384-f2974a9e15da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:46.004222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8865f578-e55d-4b64-9384-f2974a9e15da tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/ips" status: 200 len: 151 microversion: 2.20 time: 0.042129 May 26 12:56:46.013472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 450/874] 10.222.0.60 () {60 vars in 1288 bytes} [Thu May 26 12:56:45 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:56:49.169231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9349f81-49d9-4590-b923-3e81fff45ba7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:49.169849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9349f81-49d9-4590-b923-3e81fff45ba7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:49.172391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=9 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:49.173066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=25 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:49.178078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9349f81-49d9-4590-b923-3e81fff45ba7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:49.178520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9349f81-49d9-4590-b923-3e81fff45ba7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:49.179313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9349f81-49d9-4590-b923-3e81fff45ba7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:49.179728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9349f81-49d9-4590-b923-3e81fff45ba7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:49.201689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-a9349f81-49d9-4590-b923-3e81fff45ba7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lazy-loading 'flavor' on Instance uuid cdeafbfd-a134-4f97-a26a-f89140e94b94 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:56:49.782637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9349f81-49d9-4590-b923-3e81fff45ba7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/action" status: 202 len: 0 microversion: 2.20 time: 0.617470 May 26 12:56:49.783244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 425/875] 10.222.0.60 () {62 vars in 1318 bytes} [Thu May 26 12:56:49 2022] POST /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:56:49.792194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:49.792810 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:49.799836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:49.800295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:49.801065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:49.801511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:49.943648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:49.951505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:49.953006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:49.954169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2797f1c-f4ca-49e7-b4c7-7d971ba7d357 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.166662 May 26 12:56:49.954764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 451/876] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:49 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:56:50.973225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:50.974720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:50.981086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:50.981530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:50.982287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:50.982750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:51.113120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:51.121137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:51.122953 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:51.124112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-37530455-bbd2-4cbc-b375-7890f4a69a6c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.155828 May 26 12:56:51.124666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 426/877] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:50 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:56:52.143398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:52.144000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:52.151012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:52.151455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:52.152215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:52.152647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:52.284142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:52.292891 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:52.294403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:52.295603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f7a5e0a-de95-4036-a3e0-8d5050afe183 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.156189 May 26 12:56:52.296159 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 452/878] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:52 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:56:53.314121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:53.314793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:53.321509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:53.321959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:53.322787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:53.323232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:53.529632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:53.533796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:53.535293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:53.536624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e7d5896-2df4-4942-b11f-b0bbc07cc80f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.226591 May 26 12:56:53.537189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 427/879] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:53 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:56:54.203338 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-a4774b9a-cc3e-4294-ba4a-9f98bbcf8fb0 req-9c53072b-a84b-4817-a733-8fb146420456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3a12be-8748-41ab-a6a4-17d666ea34d0", "tag": "e5d66805-9eb5-4134-a395-25cf61316cc2"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:54.207121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4d372560-ed01-4772-bc12-2d1ca32e19db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:54.207735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4d372560-ed01-4772-bc12-2d1ca32e19db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:54.212017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a4774b9a-cc3e-4294-ba4a-9f98bbcf8fb0 req-9c53072b-a84b-4817-a733-8fb146420456 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:54.212471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a4774b9a-cc3e-4294-ba4a-9f98bbcf8fb0 req-9c53072b-a84b-4817-a733-8fb146420456 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:54.214583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d372560-ed01-4772-bc12-2d1ca32e19db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:54.215039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d372560-ed01-4772-bc12-2d1ca32e19db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:54.215818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d372560-ed01-4772-bc12-2d1ca32e19db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:54.216937 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d372560-ed01-4772-bc12-2d1ca32e19db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:54.225760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-a4774b9a-cc3e-4294-ba4a-9f98bbcf8fb0 req-9c53072b-a84b-4817-a733-8fb146420456 service nova] Creating event network-changed:e5d66805-9eb5-4134-a395-25cf61316cc2 for instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 on hv-cinder-81514 May 26 12:56:54.233429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-a4774b9a-cc3e-4294-ba4a-9f98bbcf8fb0 req-9c53072b-a84b-4817-a733-8fb146420456 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033150 May 26 12:56:54.234169 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 428/880] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:54.247148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4d372560-ed01-4772-bc12-2d1ca32e19db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:56:54.537812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4d372560-ed01-4772-bc12-2d1ca32e19db tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 204 len: 0 microversion: 2.1 time: 0.342128 May 26 12:56:54.539747 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 453/881] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:56:54 2022] DELETE /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:56:54.562057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6fdea878-7f0d-4a1a-b535-2387aa4a8c70 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:54.562886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6fdea878-7f0d-4a1a-b535-2387aa4a8c70 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:54.566633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:54.568863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:54.573736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fdea878-7f0d-4a1a-b535-2387aa4a8c70 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:54.573736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fdea878-7f0d-4a1a-b535-2387aa4a8c70 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:54.573736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fdea878-7f0d-4a1a-b535-2387aa4a8c70 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:54.574184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fdea878-7f0d-4a1a-b535-2387aa4a8c70 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:54.576641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:54.577229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:54.578575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:54.579338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:54.729717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:54.739780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:54.741445 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:54.742686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-66a8cfae-741f-439a-8946-f9e220da54b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.181117 May 26 12:56:54.743469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 454/882] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:54 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:56:54.776113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6fdea878-7f0d-4a1a-b535-2387aa4a8c70 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:54.783841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6fdea878-7f0d-4a1a-b535-2387aa4a8c70 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.238352 May 26 12:56:54.784512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 429/883] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:54 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:55.761672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:55.762393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:55.769083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:55.769545 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:55.771255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:55.771453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:55.802700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-08b91d60-a9d6-40c2-95dd-9ef79bb5b851 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:55.803341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-08b91d60-a9d6-40c2-95dd-9ef79bb5b851 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:55.809900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08b91d60-a9d6-40c2-95dd-9ef79bb5b851 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:55.810387 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08b91d60-a9d6-40c2-95dd-9ef79bb5b851 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:55.811195 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08b91d60-a9d6-40c2-95dd-9ef79bb5b851 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:55.811636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08b91d60-a9d6-40c2-95dd-9ef79bb5b851 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:55.904437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:55.912534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:55.914070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:55.915307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-146fea77-a402-47bb-947d-c007eab42a4a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.157702 May 26 12:56:55.915885 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 455/884] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:55 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:56:55.958892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08b91d60-a9d6-40c2-95dd-9ef79bb5b851 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:55.966485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-08b91d60-a9d6-40c2-95dd-9ef79bb5b851 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1570 microversion: 2.1 time: 0.167618 May 26 12:56:55.967057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 430/885] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:55 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:56.934556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:56.935193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:56.942825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:56.943300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:56.944817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:56.944817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:56.962161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-1a650543-93b2-43ff-8cbf-e622aa37f848 req-3715b467-5990-4e9c-9c39-ad4162f88d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a12be-8748-41ab-a6a4-17d666ea34d0", "name": "network-vif-deleted", "tag": "e5d66805-9eb5-4134-a395-25cf61316cc2"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:56.973175 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-1a650543-93b2-43ff-8cbf-e622aa37f848 req-3715b467-5990-4e9c-9c39-ad4162f88d37 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:56.973736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-1a650543-93b2-43ff-8cbf-e622aa37f848 req-3715b467-5990-4e9c-9c39-ad4162f88d37 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:56.985618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-1a650543-93b2-43ff-8cbf-e622aa37f848 req-3715b467-5990-4e9c-9c39-ad4162f88d37 service nova] Creating event network-vif-deleted:e5d66805-9eb5-4134-a395-25cf61316cc2 for instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 on hv-cinder-81514 May 26 12:56:56.993051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-1a650543-93b2-43ff-8cbf-e622aa37f848 req-3715b467-5990-4e9c-9c39-ad4162f88d37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034916 May 26 12:56:56.993659 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 431/886] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:56:57.000280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d2ec5be8-4a73-456f-b884-82ca20c75957 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:57.003346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d2ec5be8-4a73-456f-b884-82ca20c75957 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:57.008313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2ec5be8-4a73-456f-b884-82ca20c75957 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:57.008849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2ec5be8-4a73-456f-b884-82ca20c75957 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:57.009628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2ec5be8-4a73-456f-b884-82ca20c75957 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:57.010068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2ec5be8-4a73-456f-b884-82ca20c75957 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:57.078246 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d2ec5be8-4a73-456f-b884-82ca20c75957 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:57.086858 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d2ec5be8-4a73-456f-b884-82ca20c75957 tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1383 microversion: 2.1 time: 0.091492 May 26 12:56:57.087475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 432/887] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:56 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1383 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:57.360899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:57.370145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:57.372202 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:57.373458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4321db2b-942c-4fe0-8538-30484cbdce67 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.442939 May 26 12:56:57.374021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 456/888] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:56 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:56:58.106674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:58.107290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:58.114462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:58.115002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:58.115844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:58.116280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:58.149544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:58.149989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:58.150433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lazy-loading 'fault' on Instance uuid 6f3a12be-8748-41ab-a6a4-17d666ea34d0 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:56:58.193154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c6175803b45bf80591084ad4e92ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cc833734e44b588c6d0d52c3ca7b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:58.200793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5dad63a-4794-4108-bc80-dbbd3f1dc34c tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 200 len: 1225 microversion: 2.1 time: 0.099479 May 26 12:56:58.201350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 433/889] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:58 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:58.392956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:58.393597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:58.400061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:58.400533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:58.401361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:58.401790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:58.540086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:58.548252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:58.549987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:58.551131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e37ed90-5991-413c-ad95-cfa6ad6f1bac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.162427 May 26 12:56:58.552607 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 457/890] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:58 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:56:59.218414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:59.219051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] [instance: 6f3a12be-8748-41ab-a6a4-17d666ea34d0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:59.226152 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:59.226633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:59.227400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:59.227836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:59.241431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] HTTP exception thrown: Instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 could not be found. May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Request method failure captured: May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 HTTP/1.1 May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3d6ZIHF_PMaXSkMKoGU_1yRTt93PkT9LMhSeKH7bxkw451Lz-ElUcmY_vxxLPc-9911rKIjrD8Yskjch5kFicppoG3-4O1iiMVYbkhUBdiIyauxOQASSLpULNx8z6e4bh33oGTQJ46r-syO8byVmF_BJ-BAjkVN7JLHkiIeyAD6i7g May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: d6cc833734e44b588c6d0d52c3ca7b84 May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestShelveInstance-68357680 May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:56:59.243079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d6cc833734e44b588c6d0d52c3ca7b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d6cc833734e44b588c6d0d52c3ca7b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d6cc833734e44b588c6d0d52c3ca7b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d6cc833734e44b588c6d0d52c3ca7b84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestShelveInstance-68357680 May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: d6cc833734e44b588c6d0d52c3ca7b84 May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestShelveInstance-68357680 May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-TestShelveInstance-68357680-project May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 160c6175803b45bf80591084ad4e92ba May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestShelveInstance-68357680-project May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 could not be found. May 26 12:56:59.244711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '6f3a12be-8748-41ab-a6a4-17d666ea34d0'} May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 could not be found. May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:56:59.245715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 could not be found. May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 could not be found. May 26 12:56:59.247550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:56:59.249022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Returning 404 to user: Instance 6f3a12be-8748-41ab-a6a4-17d666ea34d0 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:56:59.249022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e96fdcb4-96fb-45ce-9636-b6ada02adead tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0" status: 404 len: 111 microversion: 2.1 time: 0.030285 May 26 12:56:59.249022 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 434/891] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:56:59 2022] GET /compute/v2.1/servers/6f3a12be-8748-41ab-a6a4-17d666ea34d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:56:59.491050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-115a1218-7d88-49db-beae-f76542afee6b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] Calling method '.version_select at 0x7f498c148040>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:59.571333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:59.571951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:59.577989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:59.578438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:59.579246 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:59.579684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:59.587692 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-115a1218-7d88-49db-beae-f76542afee6b tempest-TestShelveInstance-68357680 tempest-TestShelveInstance-68357680-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1173115337" status: 202 len: 0 microversion: 2.1 time: 0.101358 May 26 12:56:59.588521 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 458/892] 10.222.0.60 () {58 vars in 1253 bytes} [Thu May 26 12:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1173115337 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:56:59.725536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:59.736410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:59.736410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:59.737199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-260a2bf5-9e1e-4078-a012-f36babcef996 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.170653 May 26 12:56:59.737807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 435/893] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:56:59 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:57:00.757216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:00.757828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:00.765344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:00.765791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:00.766591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:00.767038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:00.912680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:00.921487 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:00.928256 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:00.928256 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c08fc264-9df3-4937-b173-d854319d650f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.172033 May 26 12:57:00.928256 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 459/894] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:00 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:01.947262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:01.947889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:01.954411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:01.954904 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:01.955685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:01.956134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:02.215596 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:02.223462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:02.225011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:02.226175 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-273963ee-6361-4a42-a0ba-91f19789c86f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1743 microversion: 2.20 time: 0.284607 May 26 12:57:02.226756 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 436/895] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:01 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1743 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:03.245801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:03.246874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:03.253840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:03.255284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:03.255607 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:03.256046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:03.403763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:03.412524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:03.414321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:03.415556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6ebd852-5833-47be-93c9-0a07518da9e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1743 microversion: 2.20 time: 0.173759 May 26 12:57:03.416116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 460/896] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:03 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:04.435304 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:04.435912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:04.443114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:04.443566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:04.445438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:04.445438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:04.584750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:04.593615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:04.595473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:04.596669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c677f767-05cb-4b9d-b7b6-e6c5af60d05f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1743 microversion: 2.20 time: 0.165326 May 26 12:57:04.597230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 437/897] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:04 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:05.616583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:05.618006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:05.626250 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:05.626729 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:05.627530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:05.627965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:05.849683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:05.857704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:05.859229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:05.860403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a8b52e3c-ad51-4891-83ec-d1ce2f6fb506 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1743 microversion: 2.20 time: 0.248925 May 26 12:57:05.860962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 461/898] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:05 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:05.876542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-6e4944b0-0b07-40c6-96bc-c39288e8040b req-5caa18ad-6357-4633-b548-60f956c110ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeafbfd-a134-4f97-a26a-f89140e94b94", "name": "network-vif-plugged", "status": "completed", "tag": "e02acdf1-82f4-4eaf-82b0-de617a5c93e4"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:05.886100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-6e4944b0-0b07-40c6-96bc-c39288e8040b req-5caa18ad-6357-4633-b548-60f956c110ff service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:05.888716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-6e4944b0-0b07-40c6-96bc-c39288e8040b req-5caa18ad-6357-4633-b548-60f956c110ff service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:05.897976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-6e4944b0-0b07-40c6-96bc-c39288e8040b req-5caa18ad-6357-4633-b548-60f956c110ff service nova] Creating event network-vif-plugged:e02acdf1-82f4-4eaf-82b0-de617a5c93e4 for instance cdeafbfd-a134-4f97-a26a-f89140e94b94 on hv-cinder-81514 May 26 12:57:05.903309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-6e4944b0-0b07-40c6-96bc-c39288e8040b req-5caa18ad-6357-4633-b548-60f956c110ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030371 May 26 12:57:05.903892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 438/899] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:06.880606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:06.881222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:06.887901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:06.888353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:06.889118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:06.889553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:07.104049 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:07.112528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:07.114192 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:07.115399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-74701680-8e89-4563-91b5-47fa99899394 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1743 microversion: 2.20 time: 0.239468 May 26 12:57:07.115964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 462/900] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:06 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1743 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:08.134432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:08.135184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:08.142226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:08.142734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:08.143501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:08.143951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:08.281720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:08.290869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:08.292438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:08.293647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46299062-de93-4163-bc39-131f9fa4b988 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.163341 May 26 12:57:08.294266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 439/901] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:08 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:09.314004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:09.314653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:09.328019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.333887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.333887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.333887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.507462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:09.515813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:09.517679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:09.518948 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4da27288-0971-4313-a710-1b2e3036e5b8 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.209372 May 26 12:57:09.520417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 463/902] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:09 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:10.539430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:10.539948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:10.547185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:10.547852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:10.548649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:10.549231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:10.707273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:10.715330 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:10.719146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:10.721592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89e05905-bbab-4b8d-8428-feee5c31b415 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.186865 May 26 12:57:10.722161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 440/903] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:10 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:11.739959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:11.740660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:11.747532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:11.747985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:11.748741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:11.749179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:11.891500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:11.900585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:11.905561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:11.905561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bac8f03-672f-410d-bead-663fa84c605f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.167390 May 26 12:57:11.905561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 464/904] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:11 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:12.922870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:12.923487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:12.930467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:12.931062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:12.932330 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:12.933224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:13.078907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:13.082734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:13.095544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:13.098210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:13.104804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a5e3c5dd-09e4-4bba-a343-93f9e9624dec tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.186059 May 26 12:57:13.105415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 441/905] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:12 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:14.123167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:14.123767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:14.130824 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.131536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.132648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.133186 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.295838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:14.306036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:14.308328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:14.309597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f71f8f6f-4873-4b65-a34f-9abd2c424fe3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.190815 May 26 12:57:14.310239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 465/906] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:14 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:15.329770 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:15.330371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:15.338406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:15.338879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:15.339660 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:15.340096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:15.498585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:15.508015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:15.509515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:15.510809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e673ca2c-919a-43de-b655-84598cdeaaf7 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.185613 May 26 12:57:15.515443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 442/907] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:15 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:16.531596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:16.532904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:16.541276 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:16.541807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:16.542677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:16.543199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:16.559816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:16.695905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:16.704220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:16.705820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:16.707712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d21e656c-54b1-4edc-a5f5-613354a94170 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.181444 May 26 12:57:16.708225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 466/908] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:16 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:17.727399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:17.728615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:17.735234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.736365 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.737333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.737955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.890367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:17.901615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:17.903152 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:17.904315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5138d898-570f-418f-98e8-19663ecdde77 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.181979 May 26 12:57:17.904854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 443/909] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:17 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:18.923248 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:18.923873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:18.932361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:18.932814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:18.933737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:18.934199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:19.086901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:19.099353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:19.100854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:19.110106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc50f5db-39fc-499a-ad2b-db3b1b759b2c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.182778 May 26 12:57:19.110106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 467/910] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:18 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:20.124034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:20.124646 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:20.126983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=41 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:20.133733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:20.139055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:20.139055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:20.139055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:20.266080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:20.274344 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:20.276401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:20.277108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97acc5bd-2d81-4ad2-a008-9ed4b864f0e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1738 microversion: 2.20 time: 0.157225 May 26 12:57:20.277659 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 444/911] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:20 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:21.296519 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:21.297130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:21.299603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:21.304306 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:21.304757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:21.305565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:21.306043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:21.442719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:21.450823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:21.452354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:21.453511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e8faf5f5-0d96-49ea-96fd-fc1cc01f3754 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1720 microversion: 2.20 time: 0.160984 May 26 12:57:21.454064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 468/912] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:21 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:22.473303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:22.473958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:22.480559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:22.481013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:22.481779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:22.482220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:22.611134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:22.619195 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:22.620713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:22.622153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49ea27fe-af34-42aa-a394-fec53f18dc43 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1720 microversion: 2.20 time: 0.153607 May 26 12:57:22.622736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 445/913] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:22 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:23.641095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:23.641727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:23.648862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:23.649307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:23.655573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:23.655573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:23.780649 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:23.790137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:23.791710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:23.798692 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bba597d-f43a-4988-8f1d-348746f3856e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1723 microversion: 2.20 time: 0.155676 May 26 12:57:23.798692 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 469/914] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:23 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:23.811194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f560308-e8a5-410a-9887-96c3bfb88c51 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae24327f-8618-4ae2-94ac-ec6b439c9d61"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:23.812271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f560308-e8a5-410a-9887-96c3bfb88c51 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:23.818336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f560308-e8a5-410a-9887-96c3bfb88c51 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:23.818827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f560308-e8a5-410a-9887-96c3bfb88c51 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:23.824948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f560308-e8a5-410a-9887-96c3bfb88c51 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:23.824948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f560308-e8a5-410a-9887-96c3bfb88c51 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:23.943647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-380627d0-d727-4167-b6c1-b68027cccd03 req-98b346ea-557f-49c5-bb50-a531b772ed70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeafbfd-a134-4f97-a26a-f89140e94b94", "name": "network-vif-unplugged", "status": "completed", "tag": "e02acdf1-82f4-4eaf-82b0-de617a5c93e4"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:23.952368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-380627d0-d727-4167-b6c1-b68027cccd03 req-98b346ea-557f-49c5-bb50-a531b772ed70 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:23.952821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-380627d0-d727-4167-b6c1-b68027cccd03 req-98b346ea-557f-49c5-bb50-a531b772ed70 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:23.964618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-380627d0-d727-4167-b6c1-b68027cccd03 req-98b346ea-557f-49c5-bb50-a531b772ed70 service nova] Creating event network-vif-unplugged:e02acdf1-82f4-4eaf-82b0-de617a5c93e4 for instance cdeafbfd-a134-4f97-a26a-f89140e94b94 on hv-cinder-81514 May 26 12:57:23.969731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-380627d0-d727-4167-b6c1-b68027cccd03 req-98b346ea-557f-49c5-bb50-a531b772ed70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030672 May 26 12:57:23.970376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 470/915] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:57:25.032517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f560308-e8a5-410a-9887-96c3bfb88c51 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.225602 May 26 12:57:25.033355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 446/916] 10.222.0.60 () {62 vars in 1363 bytes} [Thu May 26 12:57:23 2022] POST /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/os-volume_attachments => generated 188 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:57:25.149106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c7814c7-a290-4af0-8d8b-7ddc96d8449f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:25.149718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c7814c7-a290-4af0-8d8b-7ddc96d8449f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:25.155928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c7814c7-a290-4af0-8d8b-7ddc96d8449f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:25.156383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c7814c7-a290-4af0-8d8b-7ddc96d8449f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:25.157142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c7814c7-a290-4af0-8d8b-7ddc96d8449f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:25.157577 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c7814c7-a290-4af0-8d8b-7ddc96d8449f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:25.739451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c7814c7-a290-4af0-8d8b-7ddc96d8449f tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/os-volume_attachments/ae24327f-8618-4ae2-94ac-ec6b439c9d61" status: 202 len: 0 microversion: 2.20 time: 0.595461 May 26 12:57:25.740823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 471/917] 10.222.0.60 () {60 vars in 1456 bytes} [Thu May 26 12:57:25 2022] DELETE /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/os-volume_attachments/ae24327f-8618-4ae2-94ac-ec6b439c9d61 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:57:25.796896 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1488bcd-e57b-46af-8f78-bc260138398a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:25.797460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1488bcd-e57b-46af-8f78-bc260138398a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:25.803715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1488bcd-e57b-46af-8f78-bc260138398a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:25.804165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1488bcd-e57b-46af-8f78-bc260138398a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:25.804923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1488bcd-e57b-46af-8f78-bc260138398a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:25.805359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1488bcd-e57b-46af-8f78-bc260138398a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:25.999294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1488bcd-e57b-46af-8f78-bc260138398a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "POST /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/action" status: 202 len: 0 microversion: 2.20 time: 0.206427 May 26 12:57:25.999899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 447/918] 10.222.0.60 () {62 vars in 1318 bytes} [Thu May 26 12:57:25 2022] POST /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:57:26.009441 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:26.010132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:26.016344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:26.016805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:26.017599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:26.018040 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:26.155753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:26.164027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:26.165525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:26.166718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd5d9760-f75a-4fa5-9b3d-3309e8097fbe tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1671 microversion: 2.20 time: 0.161328 May 26 12:57:26.167271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 472/919] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:26 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:27.186891 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:27.187587 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:27.194311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:27.194794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:27.195557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:27.195993 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:27.342793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:27.351399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:27.352856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:27.354024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07802fd1-337c-4c5d-b69e-55a2a5f573dd tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1671 microversion: 2.20 time: 0.171589 May 26 12:57:27.354597 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 448/920] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:27 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:28.374866 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:28.375807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:28.383863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:28.384318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:28.385096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:28.385536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:28.790280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:28.798231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:28.799687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:28.800883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-54238763-f290-4165-8caf-665f30549b90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.432127 May 26 12:57:28.801460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 473/921] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:28 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:29.821914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:29.823604 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:29.830665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:29.831136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:29.832691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:29.833142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:29.989168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:29.998452 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:30.001262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:30.002538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d4f1a954-5dbd-4385-84f7-ebecc80a1fe5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.186421 May 26 12:57:30.003318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 449/922] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:29 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:31.023842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:31.024929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:31.034245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:31.035415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:31.036349 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:31.036855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:31.170947 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:31.180251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:31.181867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:31.183224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d1619b48-8b4d-426a-baa6-386a62e1ee32 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.165621 May 26 12:57:31.184071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 474/923] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:31 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:32.202451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:32.203797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:32.210941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:32.211710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:32.212711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:32.213435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:32.371968 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:32.379867 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:32.381374 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:32.382517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c723a9d9-6049-4ffc-8ce2-d88796cbdd0e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.184311 May 26 12:57:32.383083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 450/924] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:32 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:33.400997 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:33.405746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:33.410573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:33.410573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:33.410573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:33.411224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:33.554592 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:33.562921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:33.564694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:33.566268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-88143c68-3a2b-432f-bfdb-f9b83502ab92 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.168751 May 26 12:57:33.566671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 475/925] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:33 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:34.585451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:34.586513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:34.593405 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:34.593859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:34.594669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:34.595115 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:34.800996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:34.810851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:34.812391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:34.814820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1677cb2-0456-40d9-8db9-f26292b21e00 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.233593 May 26 12:57:34.828208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 451/926] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:34 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:35.835767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:35.836604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:35.849854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:35.853585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:35.853585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:35.853585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:35.995957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:36.004193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:36.005714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:36.006917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d040f3f6-84d7-4275-b912-da38ba3d9d28 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.175659 May 26 12:57:36.007478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 476/927] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:35 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:37.027636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:37.028305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:37.036208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:37.036776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:37.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:37.038158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:37.176044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:37.185750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:37.187454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:37.190313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2aa9ad98-272f-48ef-b464-d47f466ce078 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.165161 May 26 12:57:37.190313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 452/928] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:37 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:38.207951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:38.208501 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:38.215035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:38.215486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:38.216249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:38.216689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:38.396077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:38.404001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:38.405526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:38.406765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f4a8c63f-5673-45cd-92b0-ffce59eaedee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.202944 May 26 12:57:38.407350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 477/929] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:38 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:39.425748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:39.426365 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:39.432992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:39.433447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:39.434212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:39.434678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:39.570307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:39.578352 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:39.579931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:39.581602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ee74d85b-ac6b-4ad8-8476-14af836f5d99 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.159814 May 26 12:57:39.582164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 453/930] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:39 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:40.600728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:40.601281 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:40.607764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:40.608221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:40.608989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:40.609431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:40.743550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:40.751768 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:40.753673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:40.754901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-78f1cd95-7e4e-490f-91f3-17f0b500cc8b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.158746 May 26 12:57:40.755460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 478/931] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:40 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:41.773283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:41.773894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:41.780629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:41.781083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:41.781841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:41.782281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:41.910545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:41.913929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:41.918750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:41.921380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:41.921853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34f4ba1f-89c4-45a0-83ce-a1f10cc1beac tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.152475 May 26 12:57:41.922401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 454/932] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:41 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:57:42.940302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:42.941456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:42.948172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:42.948628 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:42.949409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:42.949852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:43.085109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:43.094982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:43.096496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:43.099602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb63c27c-9983-44c8-b023-9d9c21ca7c48 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.163215 May 26 12:57:43.100161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 479/933] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:42 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:43.233489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-901fbf37-efaa-4cd6-b14c-fb91bc67d3f4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:43.234015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-901fbf37-efaa-4cd6-b14c-fb91bc67d3f4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:43.242675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-901fbf37-efaa-4cd6-b14c-fb91bc67d3f4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:43.243189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-901fbf37-efaa-4cd6-b14c-fb91bc67d3f4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:43.244078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-901fbf37-efaa-4cd6-b14c-fb91bc67d3f4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:43.244575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-901fbf37-efaa-4cd6-b14c-fb91bc67d3f4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:43.276121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-901fbf37-efaa-4cd6-b14c-fb91bc67d3f4 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/ips" status: 200 len: 151 microversion: 2.1 time: 0.047778 May 26 12:57:43.277128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 455/934] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 12:57:43 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:44.118569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:44.119212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:44.126171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:44.126662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:44.127436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:44.127904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:44.288814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:44.296897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:44.298401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:44.299589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fbb92fa0-d0c0-43aa-b4f3-c2b21cb62435 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.184906 May 26 12:57:44.300465 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 480/935] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:44 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:57:45.319007 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:45.319625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:45.327458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:45.327648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:45.328461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:45.328889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:45.528446 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:45.537165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:45.539407 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:45.540582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59de9d71-e260-4198-acdb-545a95954e85 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.226612 May 26 12:57:45.541132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 456/936] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:45 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:46.391845 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e5c9a609-a6eb-4a00-85be-f824edbe5068 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "871ed59d-d21a-46e0-a4f0-1c85766738f4"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:46.392909 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e5c9a609-a6eb-4a00-85be-f824edbe5068 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:46.400079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5c9a609-a6eb-4a00-85be-f824edbe5068 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:46.400524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5c9a609-a6eb-4a00-85be-f824edbe5068 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:46.401306 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5c9a609-a6eb-4a00-85be-f824edbe5068 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:46.401745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5c9a609-a6eb-4a00-85be-f824edbe5068 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:46.404209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:46.558908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:46.559518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:46.565976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:46.566431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:46.567233 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:46.568695 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:46.710386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:46.718678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:46.720249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:46.721410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af721915-c788-4645-b784-5594521ab65e tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.166387 May 26 12:57:46.721959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 457/937] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:46 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:57:47.310744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e5c9a609-a6eb-4a00-85be-f824edbe5068 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "POST /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.922929 May 26 12:57:47.311369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 481/938] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 12:57:46 2022] POST /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments => generated 194 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:47.740741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:47.741383 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:47.747746 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:47.748226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:47.748991 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:47.749427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:47.878403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:47.887378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:47.888899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:47.890073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-74a64fb4-8434-4753-8b99-79c2f62d542a tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.153702 May 26 12:57:47.890651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 458/939] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:47 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:48.076921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-f9339556-b2eb-492f-b81e-a5af1865d8ad req-63d2513b-f0a3-4ff0-ba30-718e3488a473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeafbfd-a134-4f97-a26a-f89140e94b94", "name": "network-vif-plugged", "status": "completed", "tag": "e02acdf1-82f4-4eaf-82b0-de617a5c93e4"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:48.086498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f9339556-b2eb-492f-b81e-a5af1865d8ad req-63d2513b-f0a3-4ff0-ba30-718e3488a473 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:48.087003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f9339556-b2eb-492f-b81e-a5af1865d8ad req-63d2513b-f0a3-4ff0-ba30-718e3488a473 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:48.097938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-f9339556-b2eb-492f-b81e-a5af1865d8ad req-63d2513b-f0a3-4ff0-ba30-718e3488a473 service nova] Creating event network-vif-plugged:e02acdf1-82f4-4eaf-82b0-de617a5c93e4 for instance cdeafbfd-a134-4f97-a26a-f89140e94b94 on hv-cinder-81514 May 26 12:57:48.103563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-f9339556-b2eb-492f-b81e-a5af1865d8ad req-63d2513b-f0a3-4ff0-ba30-718e3488a473 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031314 May 26 12:57:48.104142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 482/940] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:48.908566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:48.909169 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:48.916252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:48.916700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:48.917459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:48.917896 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:49.045852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:49.054551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:49.056070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:49.057207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-82fbf276-2058-4ec2-aa79-bcdf4c0b921d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.152555 May 26 12:57:49.057758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 459/941] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:48 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:50.076989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:50.077720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:50.083907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:50.084623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:50.085400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:50.085841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:50.220130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:50.228208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:50.229719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:50.230918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f6a7b41f-4c78-43f3-9b20-d4171018f1e3 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.158670 May 26 12:57:50.231490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 483/942] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:50 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:51.249824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:51.250428 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:51.252816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=34 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:51.257539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:51.257993 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:51.258817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:51.259255 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:51.392064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:51.400046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:51.401572 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:51.402760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b001f777-9ce2-46c4-8b5a-f4ff240fb879 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1729 microversion: 2.20 time: 0.157181 May 26 12:57:51.403303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 460/943] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:51 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:52.420366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:52.420978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:52.423409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=32 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:52.428530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:52.428988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:52.429833 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:52.430276 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:52.561363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:52.570251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:52.571828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:52.572994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7824e3a-deb6-4bcb-b120-41b3acd6aab0 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1716 microversion: 2.20 time: 0.156551 May 26 12:57:52.573552 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 484/944] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:57:52 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:57:55.957214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1bc12137-2f65-4d9c-8613-489f3ced7940 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:55.957736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1bc12137-2f65-4d9c-8613-489f3ced7940 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:55.963791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bc12137-2f65-4d9c-8613-489f3ced7940 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:55.964241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bc12137-2f65-4d9c-8613-489f3ced7940 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:55.964996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bc12137-2f65-4d9c-8613-489f3ced7940 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:55.965428 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bc12137-2f65-4d9c-8613-489f3ced7940 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:56.049166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-1bc12137-2f65-4d9c-8613-489f3ced7940 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lazy-loading 'services' on Instance uuid 6cb33834-7db2-4be4-9ae9-3185ded84ab8 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:57:56.264008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1bc12137-2f65-4d9c-8613-489f3ced7940 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments/871ed59d-d21a-46e0-a4f0-1c85766738f4" status: 202 len: 0 microversion: 2.1 time: 0.310631 May 26 12:57:56.265154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 461/945] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 12:57:55 2022] DELETE /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments/871ed59d-d21a-46e0-a4f0-1c85766738f4 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:57:56.273278 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4940ef8f-870e-493a-af2d-ada0a7004e01 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:56.274275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4940ef8f-870e-493a-af2d-ada0a7004e01 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:56.281335 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4940ef8f-870e-493a-af2d-ada0a7004e01 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:56.282115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4940ef8f-870e-493a-af2d-ada0a7004e01 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:56.282740 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4940ef8f-870e-493a-af2d-ada0a7004e01 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:56.283042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4940ef8f-870e-493a-af2d-ada0a7004e01 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:56.315870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4940ef8f-870e-493a-af2d-ada0a7004e01 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046769 May 26 12:57:56.316430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 485/946] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:57:56 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:57.328343 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88b841b1-9bdd-48c0-beed-ac5b829e22cb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:57.329400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-88b841b1-9bdd-48c0-beed-ac5b829e22cb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:57.336340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88b841b1-9bdd-48c0-beed-ac5b829e22cb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:57.336787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88b841b1-9bdd-48c0-beed-ac5b829e22cb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:57.337557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88b841b1-9bdd-48c0-beed-ac5b829e22cb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:57.337995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88b841b1-9bdd-48c0-beed-ac5b829e22cb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:57.368172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-88b841b1-9bdd-48c0-beed-ac5b829e22cb tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 May 26 12:57:57.368725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 462/947] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:57:57 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:58.379575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b4b9640d-d168-4abe-ba64-4e0392f982cf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:58.380491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b4b9640d-d168-4abe-ba64-4e0392f982cf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:58.387456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4b9640d-d168-4abe-ba64-4e0392f982cf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:58.387903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4b9640d-d168-4abe-ba64-4e0392f982cf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:58.388679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4b9640d-d168-4abe-ba64-4e0392f982cf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:58.389112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4b9640d-d168-4abe-ba64-4e0392f982cf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:58.417230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b4b9640d-d168-4abe-ba64-4e0392f982cf tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041626 May 26 12:57:58.417851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 486/948] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 12:57:58 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:57:58.476439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd9382eb-0548-4da6-8dba-b46ee93436ab tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:58.477011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd9382eb-0548-4da6-8dba-b46ee93436ab tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:58.483396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd9382eb-0548-4da6-8dba-b46ee93436ab tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:58.483846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd9382eb-0548-4da6-8dba-b46ee93436ab tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:58.484609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd9382eb-0548-4da6-8dba-b46ee93436ab tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:58.485043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd9382eb-0548-4da6-8dba-b46ee93436ab tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:58.519451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd9382eb-0548-4da6-8dba-b46ee93436ab tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:57:58.786566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd9382eb-0548-4da6-8dba-b46ee93436ab tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 204 len: 0 microversion: 2.1 time: 0.314276 May 26 12:57:58.787631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 463/949] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:57:58 2022] DELETE /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:57:58.795622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fef8d44-6d8e-4868-bfe5-b70845f0c6e1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:58.796230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fef8d44-6d8e-4868-bfe5-b70845f0c6e1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:58.802211 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fef8d44-6d8e-4868-bfe5-b70845f0c6e1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:58.803317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fef8d44-6d8e-4868-bfe5-b70845f0c6e1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:58.804081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fef8d44-6d8e-4868-bfe5-b70845f0c6e1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:58.804581 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fef8d44-6d8e-4868-bfe5-b70845f0c6e1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:58.953732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fef8d44-6d8e-4868-bfe5-b70845f0c6e1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:58.961733 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fef8d44-6d8e-4868-bfe5-b70845f0c6e1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1682 microversion: 2.1 time: 0.169879 May 26 12:57:58.962312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 487/950] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:57:58 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:59.979561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ec43862-7c11-4450-bf0d-ea38e0ac6858 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:59.980284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0ec43862-7c11-4450-bf0d-ea38e0ac6858 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:59.987001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ec43862-7c11-4450-bf0d-ea38e0ac6858 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:59.987452 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ec43862-7c11-4450-bf0d-ea38e0ac6858 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:59.988215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ec43862-7c11-4450-bf0d-ea38e0ac6858 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:59.988653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ec43862-7c11-4450-bf0d-ea38e0ac6858 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:00.121203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0ec43862-7c11-4450-bf0d-ea38e0ac6858 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:00.128675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0ec43862-7c11-4450-bf0d-ea38e0ac6858 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1682 microversion: 2.1 time: 0.153317 May 26 12:58:00.129245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 464/951] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:57:59 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:01.149580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-75ae5db5-7456-4458-a645-e272a5dfa212 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:01.149580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-75ae5db5-7456-4458-a645-e272a5dfa212 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:01.154284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75ae5db5-7456-4458-a645-e272a5dfa212 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:01.154766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75ae5db5-7456-4458-a645-e272a5dfa212 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:01.155544 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75ae5db5-7456-4458-a645-e272a5dfa212 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:01.156028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75ae5db5-7456-4458-a645-e272a5dfa212 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:01.287800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-75ae5db5-7456-4458-a645-e272a5dfa212 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:01.295298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-75ae5db5-7456-4458-a645-e272a5dfa212 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1682 microversion: 2.1 time: 0.153932 May 26 12:58:01.295879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 488/952] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:58:01 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:01.930470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-7246ab06-c03c-4f4c-a3c4-ea023199c4dc req-4b082f4a-d7f5-46be-ad41-51409f476c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb33834-7db2-4be4-9ae9-3185ded84ab8", "name": "network-vif-deleted", "tag": "d3779a64-ca3f-4d23-89b4-aa2278bd5bdf"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:58:01.939192 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7246ab06-c03c-4f4c-a3c4-ea023199c4dc req-4b082f4a-d7f5-46be-ad41-51409f476c6c service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:01.939640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7246ab06-c03c-4f4c-a3c4-ea023199c4dc req-4b082f4a-d7f5-46be-ad41-51409f476c6c service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:01.951829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-7246ab06-c03c-4f4c-a3c4-ea023199c4dc req-4b082f4a-d7f5-46be-ad41-51409f476c6c service nova] Creating event network-vif-deleted:d3779a64-ca3f-4d23-89b4-aa2278bd5bdf for instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 on hv-cinder-81514 May 26 12:58:01.956908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-7246ab06-c03c-4f4c-a3c4-ea023199c4dc req-4b082f4a-d7f5-46be-ad41-51409f476c6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031030 May 26 12:58:01.957623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 465/953] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:02.313100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:02.313713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:02.320614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:02.321153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:02.322082 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:02.322620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:02.356262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:02.356726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:02.357172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lazy-loading 'fault' on Instance uuid 6cb33834-7db2-4be4-9ae9-3185ded84ab8 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:58:02.403077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a275f65a3544a5b073fbf1ee10034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffce3a08ba34b79aadf8d0399aff80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:02.410726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94d44fef-1f7d-4903-94c1-57dcd142808d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 200 len: 1331 microversion: 2.1 time: 0.101754 May 26 12:58:02.411302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 489/954] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:58:02 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:03.429199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:03.429959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:03.436123 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:03.436572 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:03.437327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:03.437760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:03.453008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 HTTP/1.1 May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:58:03.455050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:03.456667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '6cb33834-7db2-4be4-9ae9-3185ded84ab8'} May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:03.457542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:03.460064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:03.461564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:03.461564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-620bf478-1f55-44ad-b742-9ebbb5a1a61f tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 404 len: 111 microversion: 2.1 time: 0.031736 May 26 12:58:03.461564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 466/955] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:58:03 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:03.466258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b8d3e62d-11ee-453a-adfd-ec96645a7c6d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '.version_select at 0x7f498c2aa9d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:03.554068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b8d3e62d-11ee-453a-adfd-ec96645a7c6d tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-306267947" status: 202 len: 0 microversion: 2.1 time: 0.091754 May 26 12:58:03.554607 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 490/956] 10.222.0.60 () {58 vars in 1217 bytes} [Thu May 26 12:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-306267947 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:58:05.606546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:05.607052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:05.613432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:05.613884 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:05.614692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:05.615710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:05.629191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 HTTP/1.1 May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:58:05.631434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.632985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '6cb33834-7db2-4be4-9ae9-3185ded84ab8'} May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:05.633717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.635055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:05.636254 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:05.636254 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6a7bb38-eb7f-4061-a9d6-e8f3891e6d98 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 404 len: 111 microversion: 2.1 time: 0.030082 May 26 12:58:05.636254 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 467/957] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:58:05 2022] DELETE /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:05.641514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:05.642124 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 6cb33834-7db2-4be4-9ae9-3185ded84ab8] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:05.649185 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:05.649631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:05.650386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:05.650855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:05.663568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 HTTP/1.1 May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:58:05.665196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.666745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '6cb33834-7db2-4be4-9ae9-3185ded84ab8'} May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:05.667629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. May 26 12:58:05.669189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:05.670442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 6cb33834-7db2-4be4-9ae9-3185ded84ab8 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:05.670442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45072159-d6cd-4c55-b351-4d2c301daa44 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8" status: 404 len: 111 microversion: 2.1 time: 0.028885 May 26 12:58:05.670442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 491/958] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:58:05 2022] GET /compute/v2.1/servers/6cb33834-7db2-4be4-9ae9-3185ded84ab8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:06.907809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:06.908305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:06.914777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:06.915225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:06.915989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:06.916420 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:06.929996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 HTTP/1.1 May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:58:06.932741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.934077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '084c31a2-f433-4477-8388-749a59d8b900'} May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:06.934854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.936156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:06.937569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:06.937569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-63087327-87d1-4029-9ec7-db4adbbb4aea tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 404 len: 111 microversion: 2.1 time: 0.030982 May 26 12:58:06.937569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 468/959] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:58:06 2022] DELETE /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:06.943741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:06.944690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 084c31a2-f433-4477-8388-749a59d8b900] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:06.951016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:06.951465 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:06.952225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:06.952657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:06.966651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 HTTP/1.1 May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:58:06.968148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.969693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '084c31a2-f433-4477-8388-749a59d8b900'} May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:06.970512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. May 26 12:58:06.971797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:06.972982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 084c31a2-f433-4477-8388-749a59d8b900 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:06.972982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10059c2c-6ae1-4731-9b0e-96f03e9eb1dc tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900" status: 404 len: 111 microversion: 2.1 time: 0.030035 May 26 12:58:06.972982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 492/960] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:58:06 2022] GET /compute/v2.1/servers/084c31a2-f433-4477-8388-749a59d8b900 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:06.978155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:06.978737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:06.984785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:06.985259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:06.986042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:06.986517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:07.000085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 HTTP/1.1 May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:58:07.001664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.003221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': 'c8e6512b-4f9a-4929-9cdf-099229ccd261'} May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:07.004084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.005503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:07.007912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:07.007912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-12484d04-ae1d-43e0-9cdf-56f76b7899c6 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 404 len: 111 microversion: 2.1 time: 0.028749 May 26 12:58:07.007912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 469/961] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:58:06 2022] DELETE /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:07.012229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:07.012876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: c8e6512b-4f9a-4929-9cdf-099229ccd261] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:07.018849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:07.019305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:07.020074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:07.021004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:07.034417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 HTTP/1.1 May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:58:07.035960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.038043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'c8e6512b-4f9a-4929-9cdf-099229ccd261'} May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:07.038959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. May 26 12:58:07.040427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:07.041665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance c8e6512b-4f9a-4929-9cdf-099229ccd261 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:07.041665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab4e3a31-8169-49a9-8e66-2a1a8c0e0de5 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261" status: 404 len: 111 microversion: 2.1 time: 0.029428 May 26 12:58:07.041665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 493/962] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:58:07 2022] GET /compute/v2.1/servers/c8e6512b-4f9a-4929-9cdf-099229ccd261 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:08.354881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:08.355378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:08.361785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:08.362242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:08.363046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:08.363487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:08.376975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 HTTP/1.1 May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:58:08.378494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.380085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '3f9a6c21-74a0-432e-bcb3-c91e2c45fe15'} May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:08.381568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:58:08.384800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:08.384800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d4f7ecd7-9e2b-4208-b7d6-de54eb3e95e3 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 404 len: 111 microversion: 2.1 time: 0.028889 May 26 12:58:08.384800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 470/963] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 12:58:08 2022] DELETE /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:08.388772 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:08.389394 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] [instance: 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:08.395918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:08.397025 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:08.397927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:08.398370 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:08.411528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] HTTP exception thrown: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Request method failure captured: May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 HTTP/1.1 May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3bvGOpzMjoFXxLuYpWZXxl68fvw7J16S7rWZvRKB_Q2LWtmBWl0Mb76Q-dv9WsHx5kcI--B_9oXcsdH3GcwALjxkGv44npFwMEdtEIN_-h36S32zR1myEQeiUuVOWoxo-bgKhAAjpUYx7GTQT_lTqbjBtpQQ-u22OBXUCblSWWhYco May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:58:08.413120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffce3a08ba34b79aadf8d0399aff80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: cffce3a08ba34b79aadf8d0399aff80f May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947595004 May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 98a275f65a3544a5b073fbf1ee10034b May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-947595004-project May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.414873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '3f9a6c21-74a0-432e-bcb3-c91e2c45fe15'} May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:08.415799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. May 26 12:58:08.417018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:58:08.418239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] Returning 404 to user: Instance 3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:08.418239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e08bcbb6-0f7c-4f75-ac14-71ddd61922c1 tempest-AttachVolumeNegativeTest-947595004 tempest-AttachVolumeNegativeTest-947595004-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15" status: 404 len: 111 microversion: 2.1 time: 0.029628 May 26 12:58:08.418239 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 494/964] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:58:08 2022] GET /compute/v2.1/servers/3f9a6c21-74a0-432e-bcb3-c91e2c45fe15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:59.620379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e208919-cba1-45be-9192-666329fe86e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:59.624804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e208919-cba1-45be-9192-666329fe86e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:59.624804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:59.624804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:59.630282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e208919-cba1-45be-9192-666329fe86e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:59.630758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e208919-cba1-45be-9192-666329fe86e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:59.631542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e208919-cba1-45be-9192-666329fe86e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:59.632003 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e208919-cba1-45be-9192-666329fe86e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:59.662770 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e208919-cba1-45be-9192-666329fe86e5 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046490 May 26 12:58:59.663656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 471/965] 10.222.0.60 () {60 vars in 1342 bytes} [Thu May 26 12:58:59 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:59.729409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab157afa-a74d-44a6-84a9-4512c6d9f4de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:59.730016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab157afa-a74d-44a6-84a9-4512c6d9f4de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:59.732098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:59.732743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:59.737509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab157afa-a74d-44a6-84a9-4512c6d9f4de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:59.737960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab157afa-a74d-44a6-84a9-4512c6d9f4de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:59.738784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab157afa-a74d-44a6-84a9-4512c6d9f4de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:59.739260 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab157afa-a74d-44a6-84a9-4512c6d9f4de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:59.765236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab157afa-a74d-44a6-84a9-4512c6d9f4de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:59:00.163225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab157afa-a74d-44a6-84a9-4512c6d9f4de tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 204 len: 0 microversion: 2.20 time: 0.437343 May 26 12:59:00.163898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 495/966] 10.222.0.60 () {60 vars in 1279 bytes} [Thu May 26 12:58:59 2022] DELETE /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:59:00.173749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:00.174362 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:00.182700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:00.183149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:00.183987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:00.184425 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:00.322558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:00.330340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:00.331922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:00.334228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7552cb50-3153-4b03-ba96-f0053892e719 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.165848 May 26 12:59:00.334870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 472/967] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:00 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:59:01.353844 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:01.354634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:01.361534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:01.361982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:01.362778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:01.363225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:01.501058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:01.509774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:01.511701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:01.512900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f26f047-ad61-4fe7-81ff-12fe77415eee tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.164537 May 26 12:59:01.513482 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 496/968] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:01 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:59:02.539016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:02.539016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:02.545171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:02.545630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:02.546400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:02.546905 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:02.676021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:02.684987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:02.686506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:02.687693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0fdfb1e0-2c87-4595-ba91-146599f7e873 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.155576 May 26 12:59:02.688242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 473/969] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:02 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:59:03.706249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:03.706893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:03.713876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:03.714328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:03.715121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:03.715561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:03.843249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:03.851659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:03.853151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:03.854303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8730bb00-11e8-44d2-a188-f0b43aca1252 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.151964 May 26 12:59:03.854890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 497/970] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:03 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:59:04.873293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:04.873961 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:04.881180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:04.881622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:04.882389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:04.882858 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:05.013969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:05.023210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:05.024794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:05.025952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9d27d0ae-a1d6-471f-b1dc-b443a9167b0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1722 microversion: 2.20 time: 0.156892 May 26 12:59:05.026504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 474/971] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:04 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:59:06.057746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:06.058355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:06.069317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:06.072138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:06.073081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:06.073602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:06.146611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:06.156230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:06.157722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:06.159093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-38a07141-69f5-43b6-b574-97d71b10bb19 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1654 microversion: 2.20 time: 0.115789 May 26 12:59:06.160405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 498/972] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:06 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1654 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:59:06.302351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-942e246b-3439-4344-ad22-49dd0a4c4b2c req-3b51f2ca-4c0c-4c7d-a320-88194881f4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeafbfd-a134-4f97-a26a-f89140e94b94", "name": "network-vif-deleted", "tag": "e02acdf1-82f4-4eaf-82b0-de617a5c93e4"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:06.315173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-942e246b-3439-4344-ad22-49dd0a4c4b2c req-3b51f2ca-4c0c-4c7d-a320-88194881f4f3 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:06.318356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-942e246b-3439-4344-ad22-49dd0a4c4b2c req-3b51f2ca-4c0c-4c7d-a320-88194881f4f3 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:06.331163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-942e246b-3439-4344-ad22-49dd0a4c4b2c req-3b51f2ca-4c0c-4c7d-a320-88194881f4f3 service nova] Creating event network-vif-deleted:e02acdf1-82f4-4eaf-82b0-de617a5c93e4 for instance cdeafbfd-a134-4f97-a26a-f89140e94b94 on hv-cinder-81514 May 26 12:59:06.337931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-942e246b-3439-4344-ad22-49dd0a4c4b2c req-3b51f2ca-4c0c-4c7d-a320-88194881f4f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039492 May 26 12:59:06.339218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 475/973] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:59:07.178085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:07.178803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:07.185501 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:07.186011 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:07.187083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:07.187583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:07.219151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:07.219599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:07.220050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lazy-loading 'fault' on Instance uuid cdeafbfd-a134-4f97-a26a-f89140e94b94 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:59:07.260979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:07.269459 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:07.271514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34cd6fbd9b654e31a387acc25ee94d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60655349037a415e8d26e794e9d3cc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:07.272706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8ce00481-38bc-4d46-97c4-37c6a3285b86 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 200 len: 1370 microversion: 2.20 time: 0.098699 May 26 12:59:07.273259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 499/974] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:07 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:59:08.296429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:08.296429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:08.301971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:08.302420 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:08.303221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:08.303661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:08.316692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] HTTP exception thrown: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Request method failure captured: May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 HTTP/1.1 May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3demH7vRot_pDpKEmKgJ7vEmkbv78VjDaygZxCTnTuYMWzvPehg3crBpHMFHRg4VdTwO7mI33K9nBEcRaljvR1VNAw3f23VZZ0fzASiXcQUw12Hzbvbv5t__lmktFsqFMruq7JWgH8TGE3VJ0DTaTx7ylRStTh00BDGMpQ7kWGlyUU May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:59:08.318454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60655349037a415e8d26e794e9d3cc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 34cd6fbd9b654e31a387acc25ee94d44 May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:08.320283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': 'cdeafbfd-a134-4f97-a26a-f89140e94b94'} May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:59:08.321277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:08.325157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:08.326631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Returning 404 to user: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:59:08.326631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-acf86f86-1281-4dd6-bb48-f6529792dd0b tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 404 len: 111 microversion: 2.20 time: 0.030259 May 26 12:59:08.326631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 476/975] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:08 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:59:08.329870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0aa6e0e9-df1f-4be8-9656-7657f1b86a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '.version_select at 0x7f498c383040>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:08.427127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0aa6e0e9-df1f-4be8-9656-7657f1b86a5c tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-461462108" status: 204 len: 0 microversion: 2.20 time: 0.101510 May 26 12:59:08.427716 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 500/976] 10.222.0.60 () {60 vars in 1258 bytes} [Thu May 26 12:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-461462108 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:59:10.569893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:10.570493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:10.577583 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:10.578043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:10.578867 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:10.579313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:10.594316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] HTTP exception thrown: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Request method failure captured: May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 HTTP/1.1 May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3demH7vRot_pDpKEmKgJ7vEmkbv78VjDaygZxCTnTuYMWzvPehg3crBpHMFHRg4VdTwO7mI33K9nBEcRaljvR1VNAw3f23VZZ0fzASiXcQUw12Hzbvbv5t__lmktFsqFMruq7JWgH8TGE3VJ0DTaTx7ylRStTh00BDGMpQ7kWGlyUU May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:59:10.595916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60655349037a415e8d26e794e9d3cc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 34cd6fbd9b654e31a387acc25ee94d44 May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.597674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': 'cdeafbfd-a134-4f97-a26a-f89140e94b94'} May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:59:10.599371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.600952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:10.602474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Returning 404 to user: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:59:10.602474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aea4f885-8dab-4d6c-9e3c-617ced5a0026 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 404 len: 111 microversion: 2.20 time: 0.031390 May 26 12:59:10.602474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 477/977] 10.222.0.60 () {60 vars in 1279 bytes} [Thu May 26 12:59:10 2022] DELETE /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:59:10.607146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:10.607760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: cdeafbfd-a134-4f97-a26a-f89140e94b94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:10.615605 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:10.616103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:10.616878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:10.617350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:10.631068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] HTTP exception thrown: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Request method failure captured: May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 HTTP/1.1 May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3demH7vRot_pDpKEmKgJ7vEmkbv78VjDaygZxCTnTuYMWzvPehg3crBpHMFHRg4VdTwO7mI33K9nBEcRaljvR1VNAw3f23VZZ0fzASiXcQUw12Hzbvbv5t__lmktFsqFMruq7JWgH8TGE3VJ0DTaTx7ylRStTh00BDGMpQ7kWGlyUU May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:59:10.632812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60655349037a415e8d26e794e9d3cc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 34cd6fbd9b654e31a387acc25ee94d44 May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.634473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'cdeafbfd-a134-4f97-a26a-f89140e94b94'} May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:59:10.635405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. May 26 12:59:10.636925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:10.638460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Returning 404 to user: Instance cdeafbfd-a134-4f97-a26a-f89140e94b94 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:59:10.638460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-733e11ad-61c6-4ab8-95a8-225745a617b9 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94" status: 404 len: 111 microversion: 2.20 time: 0.031609 May 26 12:59:10.638460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 501/978] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:10 2022] GET /compute/v2.1/servers/cdeafbfd-a134-4f97-a26a-f89140e94b94 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:59:11.945182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:11.945744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:11.952075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:11.952523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:11.953285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:11.953723 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:11.966963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] HTTP exception thrown: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Request method failure captured: May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 HTTP/1.1 May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3demH7vRot_pDpKEmKgJ7vEmkbv78VjDaygZxCTnTuYMWzvPehg3crBpHMFHRg4VdTwO7mI33K9nBEcRaljvR1VNAw3f23VZZ0fzASiXcQUw12Hzbvbv5t__lmktFsqFMruq7JWgH8TGE3VJ0DTaTx7ylRStTh00BDGMpQ7kWGlyUU May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 12:59:11.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60655349037a415e8d26e794e9d3cc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 34cd6fbd9b654e31a387acc25ee94d44 May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:11.970128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '64085992-ecfa-4fbc-a713-04aff66c0042'} May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:59:11.971083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:11.972530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 12:59:11.974982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Returning 404 to user: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:59:11.974982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d59e312-309b-4fac-9803-b0051085ea4d tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 404 len: 111 microversion: 2.20 time: 0.029357 May 26 12:59:11.974982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 478/979] 10.222.0.60 () {60 vars in 1279 bytes} [Thu May 26 12:59:11 2022] DELETE /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:59:11.978931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:11.979538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] [instance: 64085992-ecfa-4fbc-a713-04aff66c0042] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:11.985904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:11.986354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:11.987143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:11.987580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:12.004103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] HTTP exception thrown: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Request method failure captured: May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 HTTP/1.1 May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3demH7vRot_pDpKEmKgJ7vEmkbv78VjDaygZxCTnTuYMWzvPehg3crBpHMFHRg4VdTwO7mI33K9nBEcRaljvR1VNAw3f23VZZ0fzASiXcQUw12Hzbvbv5t__lmktFsqFMruq7JWgH8TGE3VJ0DTaTx7ylRStTh00BDGMpQ7kWGlyUU May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 12:59:12.005669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60655349037a415e8d26e794e9d3cc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60655349037a415e8d26e794e9d3cc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 60655349037a415e8d26e794e9d3cc79 May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1927232757 May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 34cd6fbd9b654e31a387acc25ee94d44 May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1927232757-project May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:12.007443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '64085992-ecfa-4fbc-a713-04aff66c0042'} May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:59:12.009004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. May 26 12:59:12.010460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 12:59:12.011911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] Returning 404 to user: Instance 64085992-ecfa-4fbc-a713-04aff66c0042 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:59:12.011911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-435f224b-77af-4fd0-8e69-677693ca4f90 tempest-AttachVolumeShelveTestJSON-1927232757 tempest-AttachVolumeShelveTestJSON-1927232757-project] 10.222.0.60 "GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042" status: 404 len: 111 microversion: 2.20 time: 0.032025 May 26 12:59:12.011911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 502/980] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 26 12:59:11 2022] GET /compute/v2.1/servers/64085992-ecfa-4fbc-a713-04aff66c0042 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:59:23.735244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=16 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:23.735988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=32 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:23.871390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23e9a49c-1f44-43a1-808e-0da4c26a3f73 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'create', calling method: .version_select at 0x7f498c1e68b0>, body: {"keypair": {"name": "tempest-keypair-783724108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB6DKBkV2A61gbjfAKs2ryqWTT4LzBtsMveyYg/Zb9RmLddRlYwpgPzuEBlYirxhiSPQS3NuEGMLMSxZ7rtcuo/faXjXu8dIDYAgVuWGE6WOIrX3gY2DKZ5pBxiOlYILg=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:23.887219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-23e9a49c-1f44-43a1-808e-0da4c26a3f73 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Getting quotas for project fcb152674fde4beebd5a106495b1ab2c. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:59:23.891793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-23e9a49c-1f44-43a1-808e-0da4c26a3f73 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Getting quotas for user 563aa380be524bc7970d486ce9ae82c7 and project fcb152674fde4beebd5a106495b1ab2c. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:59:23.906835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR oslo.messaging._drivers.impl_rabbit [None req-23e9a49c-1f44-43a1-808e-0da4c26a3f73 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [aa4ca7a1-7031-4bc9-95e0-1d482d1338c9] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 12:59:24.915291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [None req-23e9a49c-1f44-43a1-808e-0da4c26a3f73 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [aa4ca7a1-7031-4bc9-95e0-1d482d1338c9] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50764. May 26 12:59:24.996403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23e9a49c-1f44-43a1-808e-0da4c26a3f73 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.265877 May 26 12:59:24.997060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 479/981] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 12:59:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:59:25.760155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:59:25.760698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 12:59:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:59:27.413155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2099545244", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41a238b9-8acb-4d3e-9125-ac98ac962e90"}], "security_groups": [{"name": "tempest-securitygroup--914407879"}], "key_name": "tempest-keypair-783724108", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:27.422619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:27.423381 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:27.530309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] validate_networks() for [('41a238b9-8acb-4d3e-9125-ac98ac962e90', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:59:27.969645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:59:27.970145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:59:27.970645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:59:27.971057 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:59:27.971837 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:59:27.981056 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:27.981744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:27.982825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:27.983441 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:28.002726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Getting quotas for project fcb152674fde4beebd5a106495b1ab2c. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:59:28.008907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Getting quotas for user 563aa380be524bc7970d486ce9ae82c7 and project fcb152674fde4beebd5a106495b1ab2c. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:59:28.018507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:59:28.021063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:59:28.152431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a6d78ea1-9d54-4dc3-8c24-33bd1771c458 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.740132 May 26 12:59:28.152431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 503/982] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 12:59:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:59:28.162798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ca0a850-a6e7-4fba-a599-548f44849f26 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:28.163416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ca0a850-a6e7-4fba-a599-548f44849f26 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:28.230992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ca0a850-a6e7-4fba-a599-548f44849f26 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:28.237654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ca0a850-a6e7-4fba-a599-548f44849f26 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1237 microversion: 2.1 time: 0.080162 May 26 12:59:28.238244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 480/983] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:28 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:29.255449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-16b99e15-8d55-42c4-a470-9094f7b1ff2b tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:29.256200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-16b99e15-8d55-42c4-a470-9094f7b1ff2b tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:29.310808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-16b99e15-8d55-42c4-a470-9094f7b1ff2b tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:29.318513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-16b99e15-8d55-42c4-a470-9094f7b1ff2b tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1237 microversion: 2.1 time: 0.067344 May 26 12:59:29.319081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 504/984] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:29 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:30.335785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5542fd77-344b-4aa3-b9cc-0486f8e91ab5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:30.336393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5542fd77-344b-4aa3-b9cc-0486f8e91ab5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:30.342947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5542fd77-344b-4aa3-b9cc-0486f8e91ab5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:30.343393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5542fd77-344b-4aa3-b9cc-0486f8e91ab5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:30.344146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5542fd77-344b-4aa3-b9cc-0486f8e91ab5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:30.344579 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5542fd77-344b-4aa3-b9cc-0486f8e91ab5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:30.405315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5542fd77-344b-4aa3-b9cc-0486f8e91ab5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:30.413325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5542fd77-344b-4aa3-b9cc-0486f8e91ab5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1289 microversion: 2.1 time: 0.081546 May 26 12:59:30.413875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 481/985] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:30 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1289 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:31.430744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-83904609-e7ac-4c32-91e7-11e94e130c48 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:31.431387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-83904609-e7ac-4c32-91e7-11e94e130c48 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:31.438368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83904609-e7ac-4c32-91e7-11e94e130c48 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:31.438870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83904609-e7ac-4c32-91e7-11e94e130c48 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:31.439694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83904609-e7ac-4c32-91e7-11e94e130c48 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:31.440136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83904609-e7ac-4c32-91e7-11e94e130c48 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:31.584206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83904609-e7ac-4c32-91e7-11e94e130c48 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:31.592224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-83904609-e7ac-4c32-91e7-11e94e130c48 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.166027 May 26 12:59:31.592812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 505/986] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:31 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:32.610413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbe08fc0-e004-4263-b4ad-4e00958d3a98 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:32.613140 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbe08fc0-e004-4263-b4ad-4e00958d3a98 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:32.618376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbe08fc0-e004-4263-b4ad-4e00958d3a98 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:32.618934 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbe08fc0-e004-4263-b4ad-4e00958d3a98 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:32.621418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbe08fc0-e004-4263-b4ad-4e00958d3a98 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:32.622082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbe08fc0-e004-4263-b4ad-4e00958d3a98 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:32.626035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e34c6f1e-6ecf-4ef5-8e34-40944f7c3ecc req-ed57ecd2-13e1-473e-9e3a-aa0920943ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53635b2e-ae71-4639-b46e-f532ce5708a5", "tag": "0e88b927-d546-4d09-ad0e-c13eb3a0beb2"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:32.636410 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e34c6f1e-6ecf-4ef5-8e34-40944f7c3ecc req-ed57ecd2-13e1-473e-9e3a-aa0920943ee5 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:32.637083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e34c6f1e-6ecf-4ef5-8e34-40944f7c3ecc req-ed57ecd2-13e1-473e-9e3a-aa0920943ee5 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:32.650158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e34c6f1e-6ecf-4ef5-8e34-40944f7c3ecc req-ed57ecd2-13e1-473e-9e3a-aa0920943ee5 service nova] Creating event network-changed:0e88b927-d546-4d09-ad0e-c13eb3a0beb2 for instance 53635b2e-ae71-4639-b46e-f532ce5708a5 on hv-cinder-81514 May 26 12:59:32.655534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e34c6f1e-6ecf-4ef5-8e34-40944f7c3ecc req-ed57ecd2-13e1-473e-9e3a-aa0920943ee5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033119 May 26 12:59:32.656244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 506/987] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:59:32.866239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbe08fc0-e004-4263-b4ad-4e00958d3a98 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:32.874091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbe08fc0-e004-4263-b4ad-4e00958d3a98 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.267745 May 26 12:59:32.874716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 482/988] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:32 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:33.895492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fed530b5-e864-4cf1-b120-be05f9769fdd tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:33.895492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fed530b5-e864-4cf1-b120-be05f9769fdd tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:33.899720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed530b5-e864-4cf1-b120-be05f9769fdd tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:33.900170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed530b5-e864-4cf1-b120-be05f9769fdd tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:33.900943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed530b5-e864-4cf1-b120-be05f9769fdd tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:33.901687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed530b5-e864-4cf1-b120-be05f9769fdd tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:34.031879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fed530b5-e864-4cf1-b120-be05f9769fdd tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:34.039506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fed530b5-e864-4cf1-b120-be05f9769fdd tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.151669 May 26 12:59:34.040067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 507/989] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:33 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:35.056357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-76e20016-21f7-4135-a591-e0bd332d7edb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:35.057198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-76e20016-21f7-4135-a591-e0bd332d7edb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:35.063758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76e20016-21f7-4135-a591-e0bd332d7edb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:35.064209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76e20016-21f7-4135-a591-e0bd332d7edb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:35.067640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76e20016-21f7-4135-a591-e0bd332d7edb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:35.067640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76e20016-21f7-4135-a591-e0bd332d7edb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:35.199322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-76e20016-21f7-4135-a591-e0bd332d7edb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:35.206706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-76e20016-21f7-4135-a591-e0bd332d7edb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.154096 May 26 12:59:35.208267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 483/990] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:35 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:36.224318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a1b8478c-11d2-47a7-b99e-6902901d5206 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:36.224928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a1b8478c-11d2-47a7-b99e-6902901d5206 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:36.231533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1b8478c-11d2-47a7-b99e-6902901d5206 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:36.231991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1b8478c-11d2-47a7-b99e-6902901d5206 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:36.232826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1b8478c-11d2-47a7-b99e-6902901d5206 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:36.233254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1b8478c-11d2-47a7-b99e-6902901d5206 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:36.367141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a1b8478c-11d2-47a7-b99e-6902901d5206 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:36.374430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a1b8478c-11d2-47a7-b99e-6902901d5206 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.154589 May 26 12:59:36.375120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 508/991] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:36 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:37.392488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a66a691f-dd5e-4b88-b9ae-93fcc96e345d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:37.393740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a66a691f-dd5e-4b88-b9ae-93fcc96e345d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:37.400379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a66a691f-dd5e-4b88-b9ae-93fcc96e345d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:37.400841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a66a691f-dd5e-4b88-b9ae-93fcc96e345d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:37.401790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a66a691f-dd5e-4b88-b9ae-93fcc96e345d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:37.402242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a66a691f-dd5e-4b88-b9ae-93fcc96e345d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:37.531762 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a66a691f-dd5e-4b88-b9ae-93fcc96e345d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:37.543537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a66a691f-dd5e-4b88-b9ae-93fcc96e345d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.151986 May 26 12:59:37.544117 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 484/992] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:37 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:38.567063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d498d556-5db3-477d-9524-513f638045f5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:38.567935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d498d556-5db3-477d-9524-513f638045f5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:38.572805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:38.576730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d498d556-5db3-477d-9524-513f638045f5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:38.577166 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d498d556-5db3-477d-9524-513f638045f5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:38.577958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d498d556-5db3-477d-9524-513f638045f5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:38.578403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d498d556-5db3-477d-9524-513f638045f5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:38.713340 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d498d556-5db3-477d-9524-513f638045f5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:38.721266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d498d556-5db3-477d-9524-513f638045f5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.163673 May 26 12:59:38.721856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 509/993] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:38 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:38.725764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:38.885164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-293c5913-fc04-4b93-97f4-9693e9519fd9 req-0acf14a2-6f06-4f2d-a89b-0a503d910175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53635b2e-ae71-4639-b46e-f532ce5708a5", "name": "network-vif-plugged", "status": "completed", "tag": "0e88b927-d546-4d09-ad0e-c13eb3a0beb2"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:38.893826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-293c5913-fc04-4b93-97f4-9693e9519fd9 req-0acf14a2-6f06-4f2d-a89b-0a503d910175 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:38.894293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-293c5913-fc04-4b93-97f4-9693e9519fd9 req-0acf14a2-6f06-4f2d-a89b-0a503d910175 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:38.905765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-293c5913-fc04-4b93-97f4-9693e9519fd9 req-0acf14a2-6f06-4f2d-a89b-0a503d910175 service nova] Creating event network-vif-plugged:0e88b927-d546-4d09-ad0e-c13eb3a0beb2 for instance 53635b2e-ae71-4639-b46e-f532ce5708a5 on hv-cinder-81514 May 26 12:59:38.912719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-293c5913-fc04-4b93-97f4-9693e9519fd9 req-0acf14a2-6f06-4f2d-a89b-0a503d910175 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187721 May 26 12:59:38.913339 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 485/994] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:59:39.739654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9c3da952-164d-4c43-adbe-54e32f78aaab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:39.740272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9c3da952-164d-4c43-adbe-54e32f78aaab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:39.742178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=8 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:39.748087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c3da952-164d-4c43-adbe-54e32f78aaab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:39.748549 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c3da952-164d-4c43-adbe-54e32f78aaab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:39.749318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c3da952-164d-4c43-adbe-54e32f78aaab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:39.749754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c3da952-164d-4c43-adbe-54e32f78aaab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:39.881785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c3da952-164d-4c43-adbe-54e32f78aaab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:39.889328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9c3da952-164d-4c43-adbe-54e32f78aaab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.154527 May 26 12:59:39.889982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 510/995] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:39 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:40.907485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31e06017-ce1e-4ab4-9042-c261766eed72 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:40.908220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31e06017-ce1e-4ab4-9042-c261766eed72 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:40.915071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e06017-ce1e-4ab4-9042-c261766eed72 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:40.915529 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e06017-ce1e-4ab4-9042-c261766eed72 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:40.916293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e06017-ce1e-4ab4-9042-c261766eed72 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:40.916737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e06017-ce1e-4ab4-9042-c261766eed72 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:41.051352 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31e06017-ce1e-4ab4-9042-c261766eed72 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:41.059894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31e06017-ce1e-4ab4-9042-c261766eed72 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1362 microversion: 2.1 time: 0.157019 May 26 12:59:41.060491 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 486/996] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:40 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:42.077606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a05c894d-7c5a-436a-8c26-f05e23b9014a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:42.078176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a05c894d-7c5a-436a-8c26-f05e23b9014a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:42.084916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a05c894d-7c5a-436a-8c26-f05e23b9014a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:42.087257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a05c894d-7c5a-436a-8c26-f05e23b9014a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:42.087257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a05c894d-7c5a-436a-8c26-f05e23b9014a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:42.087257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a05c894d-7c5a-436a-8c26-f05e23b9014a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:42.224362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a05c894d-7c5a-436a-8c26-f05e23b9014a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:42.224525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a05c894d-7c5a-436a-8c26-f05e23b9014a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1548 microversion: 2.1 time: 0.151172 May 26 12:59:42.225026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 511/997] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 12:59:42 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:42.241165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-509e81af-cf28-41b7-8128-06cb2548928e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:42.241750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-509e81af-cf28-41b7-8128-06cb2548928e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:42.248604 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-509e81af-cf28-41b7-8128-06cb2548928e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:42.249113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-509e81af-cf28-41b7-8128-06cb2548928e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:42.249859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-509e81af-cf28-41b7-8128-06cb2548928e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:42.250298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-509e81af-cf28-41b7-8128-06cb2548928e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:42.327059 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-509e81af-cf28-41b7-8128-06cb2548928e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090227 May 26 12:59:42.327694 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 487/998] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 26 12:59:42 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:59:43.586066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-9b3a52cb-dd1c-4c5a-97a6-54f134c55934 req-b7aaf8b7-5cdb-41f3-8365-c51139d71c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53635b2e-ae71-4639-b46e-f532ce5708a5", "tag": "0e88b927-d546-4d09-ad0e-c13eb3a0beb2"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:43.594697 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9b3a52cb-dd1c-4c5a-97a6-54f134c55934 req-b7aaf8b7-5cdb-41f3-8365-c51139d71c5a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:43.595151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9b3a52cb-dd1c-4c5a-97a6-54f134c55934 req-b7aaf8b7-5cdb-41f3-8365-c51139d71c5a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:43.606880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-9b3a52cb-dd1c-4c5a-97a6-54f134c55934 req-b7aaf8b7-5cdb-41f3-8365-c51139d71c5a service nova] Creating event network-changed:0e88b927-d546-4d09-ad0e-c13eb3a0beb2 for instance 53635b2e-ae71-4639-b46e-f532ce5708a5 on hv-cinder-81514 May 26 12:59:43.611970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-9b3a52cb-dd1c-4c5a-97a6-54f134c55934 req-b7aaf8b7-5cdb-41f3-8365-c51139d71c5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030017 May 26 12:59:43.612556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 512/999] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 12:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:00:58.587951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:58.588706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=36 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:58.757386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-91cec578-624c-4892-bb08-53a682b16697 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Action: 'create', calling method: .version_select at 0x7f498c1aee50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-193225139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRCZb//WSzA43tIbG+RigFc/hza7fJYdehCHNHnt7HUpUYep3Kzt730X5xk85cMuDVmN9efbAdEpMaM8cv/hwtFq+Uau3E305vEcfQyxATs9vtB8cJkKjB632C+lIXYzA=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:00:58.771284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-91cec578-624c-4892-bb08-53a682b16697 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Getting quotas for project 2bbaabf20652434cb79e0652ec678fbb. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:00:58.775219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-91cec578-624c-4892-bb08-53a682b16697 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Getting quotas for user 491ef95e936943d5a144876c2fe22eaf and project 2bbaabf20652434cb79e0652ec678fbb. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:00:58.851772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-91cec578-624c-4892-bb08-53a682b16697 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.265783 May 26 13:00:58.852386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 488/1000] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 13:00:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:01:10.190384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:10.191179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=42 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:10.195626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-461303cb-82d4-44d7-be30-1dac99bcc440 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:10.196288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-461303cb-82d4-44d7-be30-1dac99bcc440 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:10.204332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-461303cb-82d4-44d7-be30-1dac99bcc440 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:10.204332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-461303cb-82d4-44d7-be30-1dac99bcc440 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:10.204985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-461303cb-82d4-44d7-be30-1dac99bcc440 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:10.205510 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-461303cb-82d4-44d7-be30-1dac99bcc440 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:10.231012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-461303cb-82d4-44d7-be30-1dac99bcc440 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/ips" status: 200 len: 145 microversion: 2.1 time: 0.043627 May 26 13:01:10.231588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 513/1001] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 13:01:10 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:01:13.722084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92cea773-b059-4b3b-a827-0ebe7bbd7318 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e91d5b3-9f45-4544-a196-a900300a203c"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:13.723213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-92cea773-b059-4b3b-a827-0ebe7bbd7318 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:13.725670 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:13.726338 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:13.732019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92cea773-b059-4b3b-a827-0ebe7bbd7318 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:13.732470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92cea773-b059-4b3b-a827-0ebe7bbd7318 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:13.733235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92cea773-b059-4b3b-a827-0ebe7bbd7318 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:13.733674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92cea773-b059-4b3b-a827-0ebe7bbd7318 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:14.730147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92cea773-b059-4b3b-a827-0ebe7bbd7318 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.012547 May 26 13:01:14.736160 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 489/1002] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 13:01:13 2022] POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/os-volume_attachments => generated 194 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:01:23.287774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e98f74b-11cd-43ac-b990-3beca2777514 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:23.295331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e98f74b-11cd-43ac-b990-3beca2777514 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:23.295780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e98f74b-11cd-43ac-b990-3beca2777514 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:23.356012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e98f74b-11cd-43ac-b990-3beca2777514 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Going to try to stop instance {{(pid=124831) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 13:01:23.570130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e98f74b-11cd-43ac-b990-3beca2777514 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/action" status: 202 len: 0 microversion: 2.1 time: 0.286936 May 26 13:01:23.570814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 514/1003] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 13:01:23 2022] POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:01:23.579964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9733d74-23e6-4614-a4f0-0bc36503a1a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:23.580702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9733d74-23e6-4614-a4f0-0bc36503a1a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:23.588485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9733d74-23e6-4614-a4f0-0bc36503a1a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:23.588939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9733d74-23e6-4614-a4f0-0bc36503a1a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:23.589713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9733d74-23e6-4614-a4f0-0bc36503a1a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:23.590157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9733d74-23e6-4614-a4f0-0bc36503a1a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:23.725609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9733d74-23e6-4614-a4f0-0bc36503a1a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:23.733754 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9733d74-23e6-4614-a4f0-0bc36503a1a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.158466 May 26 13:01:23.734318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 490/1004] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:23 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:24.334981 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1694341601", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-193225139", "security_groups": [{"name": "tempest-secgroup-smoke-2017732673"}], "block_device_mapping_v2": [{"uuid": "938ec072-9a0f-46be-b5f9-e065e99730c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d5d8628a-f8b7-48d9-9cb6-83fd3ac6436c"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:24.447942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] validate_networks() for [('d5d8628a-f8b7-48d9-9cb6-83fd3ac6436c', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:01:24.752149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-53cc7a4d-37ee-498c-b42b-bbf388cc33f7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:24.752855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-53cc7a4d-37ee-498c-b42b-bbf388cc33f7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:24.759457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53cc7a4d-37ee-498c-b42b-bbf388cc33f7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:24.759912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53cc7a4d-37ee-498c-b42b-bbf388cc33f7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:24.760692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53cc7a4d-37ee-498c-b42b-bbf388cc33f7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:24.761127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53cc7a4d-37ee-498c-b42b-bbf388cc33f7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:24.809572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:01:24.810001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:01:24.810472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:01:24.811004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:01:24.811414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:01:24.820911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:24.821348 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:24.822139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:24.822610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:24.840139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Getting quotas for project 2bbaabf20652434cb79e0652ec678fbb. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:01:24.844142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Getting quotas for user 491ef95e936943d5a144876c2fe22eaf and project 2bbaabf20652434cb79e0652ec678fbb. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:01:24.891369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-53cc7a4d-37ee-498c-b42b-bbf388cc33f7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:24.899584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-53cc7a4d-37ee-498c-b42b-bbf388cc33f7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.151361 May 26 13:01:24.900139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 491/1005] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:24 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:01:24.902215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:01:24.904485 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='938ec072-9a0f-46be-b5f9-e065e99730c9',volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:01:25.315156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7af4978-1c74-4c31-8390-bfbe7f497bcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.984886 May 26 13:01:25.316611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 515/1006] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 13:01:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:01:25.326496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf933334-34db-4aae-8a1c-a50715b1956e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:25.327147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf933334-34db-4aae-8a1c-a50715b1956e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:25.382882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf933334-34db-4aae-8a1c-a50715b1956e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:25.389541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf933334-34db-4aae-8a1c-a50715b1956e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1094 microversion: 2.1 time: 0.066983 May 26 13:01:25.390416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 492/1007] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:25 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:25.916753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5c6980b0-e9c9-49d1-acef-410fb836121a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:25.917353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5c6980b0-e9c9-49d1-acef-410fb836121a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:25.924314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c6980b0-e9c9-49d1-acef-410fb836121a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:25.924771 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c6980b0-e9c9-49d1-acef-410fb836121a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:25.926173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c6980b0-e9c9-49d1-acef-410fb836121a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:25.926646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c6980b0-e9c9-49d1-acef-410fb836121a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:26.059851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5c6980b0-e9c9-49d1-acef-410fb836121a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:26.068249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5c6980b0-e9c9-49d1-acef-410fb836121a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.155472 May 26 13:01:26.068812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 516/1008] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:25 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:26.406978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-152dd8a3-6050-4678-9fcb-3f4d4165a057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:26.407586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-152dd8a3-6050-4678-9fcb-3f4d4165a057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:26.414668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152dd8a3-6050-4678-9fcb-3f4d4165a057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:26.415118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152dd8a3-6050-4678-9fcb-3f4d4165a057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:26.416087 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152dd8a3-6050-4678-9fcb-3f4d4165a057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:26.416523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152dd8a3-6050-4678-9fcb-3f4d4165a057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:26.476870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-152dd8a3-6050-4678-9fcb-3f4d4165a057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:26.484447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-152dd8a3-6050-4678-9fcb-3f4d4165a057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1144 microversion: 2.1 time: 0.081384 May 26 13:01:26.485011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 493/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:26 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:27.085328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-656c21e4-6fd6-4e9b-992f-6d7ca2329bbc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:27.086009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-656c21e4-6fd6-4e9b-992f-6d7ca2329bbc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:27.092632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-656c21e4-6fd6-4e9b-992f-6d7ca2329bbc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:27.093083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-656c21e4-6fd6-4e9b-992f-6d7ca2329bbc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:27.093922 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-656c21e4-6fd6-4e9b-992f-6d7ca2329bbc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:27.094353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-656c21e4-6fd6-4e9b-992f-6d7ca2329bbc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:27.225616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-656c21e4-6fd6-4e9b-992f-6d7ca2329bbc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:27.234058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-656c21e4-6fd6-4e9b-992f-6d7ca2329bbc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.152905 May 26 13:01:27.234647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 517/1010] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:27 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:27.501585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc0a8ee3-497a-47f8-b2b6-eea535c50426 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:27.502201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc0a8ee3-497a-47f8-b2b6-eea535c50426 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:27.509031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc0a8ee3-497a-47f8-b2b6-eea535c50426 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:27.509489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc0a8ee3-497a-47f8-b2b6-eea535c50426 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:27.510257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc0a8ee3-497a-47f8-b2b6-eea535c50426 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:27.510728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc0a8ee3-497a-47f8-b2b6-eea535c50426 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:27.574440 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc0a8ee3-497a-47f8-b2b6-eea535c50426 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:27.581755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc0a8ee3-497a-47f8-b2b6-eea535c50426 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1192 microversion: 2.1 time: 0.084014 May 26 13:01:27.582871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 494/1011] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:27 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:28.252304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6c9d80b-8614-4aa0-815d-6f9a60c8c3f9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:28.253464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6c9d80b-8614-4aa0-815d-6f9a60c8c3f9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:28.261310 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6c9d80b-8614-4aa0-815d-6f9a60c8c3f9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:28.262120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6c9d80b-8614-4aa0-815d-6f9a60c8c3f9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:28.262989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6c9d80b-8614-4aa0-815d-6f9a60c8c3f9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:28.263645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6c9d80b-8614-4aa0-815d-6f9a60c8c3f9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:28.400060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6c9d80b-8614-4aa0-815d-6f9a60c8c3f9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:28.408278 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6c9d80b-8614-4aa0-815d-6f9a60c8c3f9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.159745 May 26 13:01:28.408849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 518/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:28 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:01:28.599532 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ea8689a0-66c4-4d3f-a470-6fc610b7dc9e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:28.600083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ea8689a0-66c4-4d3f-a470-6fc610b7dc9e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:28.606425 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea8689a0-66c4-4d3f-a470-6fc610b7dc9e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:28.608202 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea8689a0-66c4-4d3f-a470-6fc610b7dc9e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:28.608202 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea8689a0-66c4-4d3f-a470-6fc610b7dc9e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:28.609248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea8689a0-66c4-4d3f-a470-6fc610b7dc9e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:28.689337 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea8689a0-66c4-4d3f-a470-6fc610b7dc9e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:28.697354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ea8689a0-66c4-4d3f-a470-6fc610b7dc9e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1210 microversion: 2.1 time: 0.102360 May 26 13:01:28.697982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 495/1013] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:28 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:29.425807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4fd92123-6b58-4608-bfef-51b5785cfedf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:29.427157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4fd92123-6b58-4608-bfef-51b5785cfedf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:29.433900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd92123-6b58-4608-bfef-51b5785cfedf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:29.434699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd92123-6b58-4608-bfef-51b5785cfedf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:29.435591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd92123-6b58-4608-bfef-51b5785cfedf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:29.436033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd92123-6b58-4608-bfef-51b5785cfedf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:29.569592 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4fd92123-6b58-4608-bfef-51b5785cfedf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:29.578062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4fd92123-6b58-4608-bfef-51b5785cfedf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.156183 May 26 13:01:29.578723 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 519/1014] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:29 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:29.719275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-100b404a-13c5-4e48-bcc2-2936b423c72d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:29.720877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-100b404a-13c5-4e48-bcc2-2936b423c72d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:29.728534 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-100b404a-13c5-4e48-bcc2-2936b423c72d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:29.729001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-100b404a-13c5-4e48-bcc2-2936b423c72d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:29.729794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-100b404a-13c5-4e48-bcc2-2936b423c72d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:29.730279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-100b404a-13c5-4e48-bcc2-2936b423c72d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:29.929369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-100b404a-13c5-4e48-bcc2-2936b423c72d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:29.943232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-100b404a-13c5-4e48-bcc2-2936b423c72d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.230291 May 26 13:01:29.944648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 496/1015] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:29 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:30.012223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-7664cf8b-d8b7-48da-9e8e-50977b897417 req-b1ca6e00-93b7-418b-b15a-aa5ee7670efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695090ba-e147-4dee-b9e6-2a6050b3b776", "tag": "286a8e35-ed65-49e9-8076-5424d60fed1c"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:30.020647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-7664cf8b-d8b7-48da-9e8e-50977b897417 req-b1ca6e00-93b7-418b-b15a-aa5ee7670efa service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:30.021701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-7664cf8b-d8b7-48da-9e8e-50977b897417 req-b1ca6e00-93b7-418b-b15a-aa5ee7670efa service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:30.033208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-7664cf8b-d8b7-48da-9e8e-50977b897417 req-b1ca6e00-93b7-418b-b15a-aa5ee7670efa service nova] Creating event network-changed:286a8e35-ed65-49e9-8076-5424d60fed1c for instance 695090ba-e147-4dee-b9e6-2a6050b3b776 on hv-cinder-81514 May 26 13:01:30.039122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-7664cf8b-d8b7-48da-9e8e-50977b897417 req-b1ca6e00-93b7-418b-b15a-aa5ee7670efa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124352 May 26 13:01:30.039728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 520/1016] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:01:30.596143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7026405d-955c-4976-8b74-f897ea8caabc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:30.596949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7026405d-955c-4976-8b74-f897ea8caabc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:30.603839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7026405d-955c-4976-8b74-f897ea8caabc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:30.604292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7026405d-955c-4976-8b74-f897ea8caabc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:30.605075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7026405d-955c-4976-8b74-f897ea8caabc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:30.605526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7026405d-955c-4976-8b74-f897ea8caabc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:30.807812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7026405d-955c-4976-8b74-f897ea8caabc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:30.815958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7026405d-955c-4976-8b74-f897ea8caabc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.223791 May 26 13:01:30.816527 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 497/1017] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:30 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:30.961941 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50a531d5-fb47-4aaf-8b06-d0b90b2fb582 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:30.962584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50a531d5-fb47-4aaf-8b06-d0b90b2fb582 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:30.968931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50a531d5-fb47-4aaf-8b06-d0b90b2fb582 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:30.969377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50a531d5-fb47-4aaf-8b06-d0b90b2fb582 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:30.970156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50a531d5-fb47-4aaf-8b06-d0b90b2fb582 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:30.970657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50a531d5-fb47-4aaf-8b06-d0b90b2fb582 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:31.112910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50a531d5-fb47-4aaf-8b06-d0b90b2fb582 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:31.121218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50a531d5-fb47-4aaf-8b06-d0b90b2fb582 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.164732 May 26 13:01:31.121788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 521/1018] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:30 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:31.833947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9aea4136-b23d-44b3-bc9d-4470705ec5f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:31.834579 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9aea4136-b23d-44b3-bc9d-4470705ec5f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:31.840974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9aea4136-b23d-44b3-bc9d-4470705ec5f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:31.841422 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9aea4136-b23d-44b3-bc9d-4470705ec5f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:31.842240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9aea4136-b23d-44b3-bc9d-4470705ec5f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:31.842708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9aea4136-b23d-44b3-bc9d-4470705ec5f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:31.975519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9aea4136-b23d-44b3-bc9d-4470705ec5f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:31.983391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9aea4136-b23d-44b3-bc9d-4470705ec5f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.153371 May 26 13:01:31.983955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 498/1019] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:31 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:32.138739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2305a98-11b5-40f4-a19b-5bf5527de98d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:32.139354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2305a98-11b5-40f4-a19b-5bf5527de98d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:32.146840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2305a98-11b5-40f4-a19b-5bf5527de98d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:32.147299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2305a98-11b5-40f4-a19b-5bf5527de98d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:32.148072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2305a98-11b5-40f4-a19b-5bf5527de98d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:32.148514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2305a98-11b5-40f4-a19b-5bf5527de98d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:32.282102 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2305a98-11b5-40f4-a19b-5bf5527de98d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:32.289754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2305a98-11b5-40f4-a19b-5bf5527de98d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.154908 May 26 13:01:32.290314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 522/1020] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:32 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:33.001033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a66023b3-6c7a-4915-b2ae-efc1a427b98e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:33.001647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a66023b3-6c7a-4915-b2ae-efc1a427b98e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:33.008840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a66023b3-6c7a-4915-b2ae-efc1a427b98e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:33.009298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a66023b3-6c7a-4915-b2ae-efc1a427b98e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:33.010105 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a66023b3-6c7a-4915-b2ae-efc1a427b98e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:33.010574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a66023b3-6c7a-4915-b2ae-efc1a427b98e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:33.140004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a66023b3-6c7a-4915-b2ae-efc1a427b98e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:33.148194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a66023b3-6c7a-4915-b2ae-efc1a427b98e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.151191 May 26 13:01:33.148764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 499/1021] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:32 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:01:33.307012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e9b7a1a-d409-4b1f-99dc-e16aab3d2b49 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:33.307660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e9b7a1a-d409-4b1f-99dc-e16aab3d2b49 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:33.314127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e9b7a1a-d409-4b1f-99dc-e16aab3d2b49 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:33.314606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e9b7a1a-d409-4b1f-99dc-e16aab3d2b49 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:33.315362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e9b7a1a-d409-4b1f-99dc-e16aab3d2b49 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:33.315797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e9b7a1a-d409-4b1f-99dc-e16aab3d2b49 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:33.448400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e9b7a1a-d409-4b1f-99dc-e16aab3d2b49 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:33.455896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e9b7a1a-d409-4b1f-99dc-e16aab3d2b49 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.152687 May 26 13:01:33.456467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 523/1022] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:33 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:34.166399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5873f71b-7f59-44ac-8658-e5a67b697c29 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:34.167096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5873f71b-7f59-44ac-8658-e5a67b697c29 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:34.173601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5873f71b-7f59-44ac-8658-e5a67b697c29 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:34.174054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5873f71b-7f59-44ac-8658-e5a67b697c29 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:34.174848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5873f71b-7f59-44ac-8658-e5a67b697c29 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:34.175290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5873f71b-7f59-44ac-8658-e5a67b697c29 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:34.317968 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5873f71b-7f59-44ac-8658-e5a67b697c29 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:34.325845 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5873f71b-7f59-44ac-8658-e5a67b697c29 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.164448 May 26 13:01:34.326402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 500/1023] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:34 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:34.472452 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-60a1496e-d769-49c3-b6ba-726f350a00ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:34.472995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-60a1496e-d769-49c3-b6ba-726f350a00ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:34.482782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60a1496e-d769-49c3-b6ba-726f350a00ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:34.483558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60a1496e-d769-49c3-b6ba-726f350a00ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:34.484393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60a1496e-d769-49c3-b6ba-726f350a00ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:34.484830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60a1496e-d769-49c3-b6ba-726f350a00ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:34.620774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-60a1496e-d769-49c3-b6ba-726f350a00ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:34.628319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-60a1496e-d769-49c3-b6ba-726f350a00ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.159822 May 26 13:01:34.628917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 524/1024] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:34 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:35.344054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92f1d42c-950f-420b-ab77-57ed5056aa04 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:35.344669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-92f1d42c-950f-420b-ab77-57ed5056aa04 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:35.351920 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92f1d42c-950f-420b-ab77-57ed5056aa04 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:35.352374 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92f1d42c-950f-420b-ab77-57ed5056aa04 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:35.353147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92f1d42c-950f-420b-ab77-57ed5056aa04 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:35.353585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92f1d42c-950f-420b-ab77-57ed5056aa04 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:35.386699 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:35.484419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-92f1d42c-950f-420b-ab77-57ed5056aa04 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:35.493325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92f1d42c-950f-420b-ab77-57ed5056aa04 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.153110 May 26 13:01:35.494153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 501/1025] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:35 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:35.646197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae3c61cb-cfc6-4da6-80af-9330cc58e933 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:35.646819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae3c61cb-cfc6-4da6-80af-9330cc58e933 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:35.648687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:35.649377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:35.654743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae3c61cb-cfc6-4da6-80af-9330cc58e933 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:35.655194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae3c61cb-cfc6-4da6-80af-9330cc58e933 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:35.655949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae3c61cb-cfc6-4da6-80af-9330cc58e933 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:35.656383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae3c61cb-cfc6-4da6-80af-9330cc58e933 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:35.786855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae3c61cb-cfc6-4da6-80af-9330cc58e933 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:35.794219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae3c61cb-cfc6-4da6-80af-9330cc58e933 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.152436 May 26 13:01:35.794824 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 525/1026] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:35 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:36.511105 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64079226-a19b-4610-8e57-ac9c20f0b60a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:36.511724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64079226-a19b-4610-8e57-ac9c20f0b60a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:36.518183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64079226-a19b-4610-8e57-ac9c20f0b60a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:36.518667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64079226-a19b-4610-8e57-ac9c20f0b60a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:36.519443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64079226-a19b-4610-8e57-ac9c20f0b60a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:36.519882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64079226-a19b-4610-8e57-ac9c20f0b60a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:36.655125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64079226-a19b-4610-8e57-ac9c20f0b60a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:36.663686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64079226-a19b-4610-8e57-ac9c20f0b60a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.156469 May 26 13:01:36.664245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 502/1027] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:36 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:36.811834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2edaa250-b5ff-4b1e-866e-bbdd57986a95 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:36.812449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2edaa250-b5ff-4b1e-866e-bbdd57986a95 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:36.819197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2edaa250-b5ff-4b1e-866e-bbdd57986a95 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:36.819652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2edaa250-b5ff-4b1e-866e-bbdd57986a95 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:36.820451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2edaa250-b5ff-4b1e-866e-bbdd57986a95 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:36.820892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2edaa250-b5ff-4b1e-866e-bbdd57986a95 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:36.971377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2edaa250-b5ff-4b1e-866e-bbdd57986a95 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:36.979563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2edaa250-b5ff-4b1e-866e-bbdd57986a95 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.171574 May 26 13:01:36.980140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 526/1028] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:36 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:37.681113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e79ea30-66fc-4803-89ff-f7a13f621f07 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:37.681726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e79ea30-66fc-4803-89ff-f7a13f621f07 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:37.688269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e79ea30-66fc-4803-89ff-f7a13f621f07 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:37.688716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e79ea30-66fc-4803-89ff-f7a13f621f07 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:37.689479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e79ea30-66fc-4803-89ff-f7a13f621f07 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:37.689919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e79ea30-66fc-4803-89ff-f7a13f621f07 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:37.816621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e79ea30-66fc-4803-89ff-f7a13f621f07 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:37.825100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e79ea30-66fc-4803-89ff-f7a13f621f07 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.147854 May 26 13:01:37.825661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 503/1029] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:37 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:37.997360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ac263695-b9c8-4633-a180-e8f3236ec762 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:37.997906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ac263695-b9c8-4633-a180-e8f3236ec762 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:38.004493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac263695-b9c8-4633-a180-e8f3236ec762 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:38.005589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac263695-b9c8-4633-a180-e8f3236ec762 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:38.006422 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac263695-b9c8-4633-a180-e8f3236ec762 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:38.006887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac263695-b9c8-4633-a180-e8f3236ec762 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:38.137997 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ac263695-b9c8-4633-a180-e8f3236ec762 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:38.145492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ac263695-b9c8-4633-a180-e8f3236ec762 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.152482 May 26 13:01:38.146110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 527/1030] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:37 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:38.843081 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-217a0fc8-bcbf-4ccd-8ece-ba5f55d488c0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:38.843697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-217a0fc8-bcbf-4ccd-8ece-ba5f55d488c0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:38.851226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-217a0fc8-bcbf-4ccd-8ece-ba5f55d488c0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:38.851682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-217a0fc8-bcbf-4ccd-8ece-ba5f55d488c0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:38.852457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-217a0fc8-bcbf-4ccd-8ece-ba5f55d488c0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:38.852902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-217a0fc8-bcbf-4ccd-8ece-ba5f55d488c0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:38.984555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-217a0fc8-bcbf-4ccd-8ece-ba5f55d488c0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:38.992493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-217a0fc8-bcbf-4ccd-8ece-ba5f55d488c0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.153301 May 26 13:01:38.993058 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 504/1031] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:38 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:39.163003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7416ec72-cd25-4af0-ae9c-a1bc6d5f3059 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:39.163619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7416ec72-cd25-4af0-ae9c-a1bc6d5f3059 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:39.170125 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7416ec72-cd25-4af0-ae9c-a1bc6d5f3059 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:39.170500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7416ec72-cd25-4af0-ae9c-a1bc6d5f3059 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:39.171300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7416ec72-cd25-4af0-ae9c-a1bc6d5f3059 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:39.171742 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7416ec72-cd25-4af0-ae9c-a1bc6d5f3059 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:39.309798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7416ec72-cd25-4af0-ae9c-a1bc6d5f3059 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:39.318102 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7416ec72-cd25-4af0-ae9c-a1bc6d5f3059 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.158682 May 26 13:01:39.322144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 528/1032] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:39 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:40.009204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d00aa437-a37f-4ba9-bf8d-4a50c5df73e7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:40.009984 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d00aa437-a37f-4ba9-bf8d-4a50c5df73e7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:40.016601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d00aa437-a37f-4ba9-bf8d-4a50c5df73e7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:40.017051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d00aa437-a37f-4ba9-bf8d-4a50c5df73e7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:40.017811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d00aa437-a37f-4ba9-bf8d-4a50c5df73e7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:40.018246 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d00aa437-a37f-4ba9-bf8d-4a50c5df73e7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:40.022381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:40.152120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d00aa437-a37f-4ba9-bf8d-4a50c5df73e7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:40.160749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d00aa437-a37f-4ba9-bf8d-4a50c5df73e7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.155343 May 26 13:01:40.162186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 505/1033] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:40 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:40.335818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6cf8f715-5b0e-4522-b231-d7897bb2de9c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:40.336436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6cf8f715-5b0e-4522-b231-d7897bb2de9c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:40.342939 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cf8f715-5b0e-4522-b231-d7897bb2de9c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:40.343401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cf8f715-5b0e-4522-b231-d7897bb2de9c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:40.344173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cf8f715-5b0e-4522-b231-d7897bb2de9c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:40.344614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cf8f715-5b0e-4522-b231-d7897bb2de9c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:40.475954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6cf8f715-5b0e-4522-b231-d7897bb2de9c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:40.483382 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6cf8f715-5b0e-4522-b231-d7897bb2de9c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.152025 May 26 13:01:40.483953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 529/1034] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:40 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:01:41.180497 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56d1974d-150d-4d24-a6e5-2ab965e65196 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:41.181153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56d1974d-150d-4d24-a6e5-2ab965e65196 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:41.188175 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56d1974d-150d-4d24-a6e5-2ab965e65196 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:41.188694 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56d1974d-150d-4d24-a6e5-2ab965e65196 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:41.189552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56d1974d-150d-4d24-a6e5-2ab965e65196 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:41.190062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56d1974d-150d-4d24-a6e5-2ab965e65196 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:41.277257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-d0515ddd-ee0e-435f-967d-5d61334cd2e9 req-e70014ff-6a25-4c3e-8b3d-d08fafa44124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695090ba-e147-4dee-b9e6-2a6050b3b776", "name": "network-vif-plugged", "status": "completed", "tag": "286a8e35-ed65-49e9-8076-5424d60fed1c"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:41.289240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d0515ddd-ee0e-435f-967d-5d61334cd2e9 req-e70014ff-6a25-4c3e-8b3d-d08fafa44124 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:41.289694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d0515ddd-ee0e-435f-967d-5d61334cd2e9 req-e70014ff-6a25-4c3e-8b3d-d08fafa44124 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:41.293473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:41.301306 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-d0515ddd-ee0e-435f-967d-5d61334cd2e9 req-e70014ff-6a25-4c3e-8b3d-d08fafa44124 service nova] Creating event network-vif-plugged:286a8e35-ed65-49e9-8076-5424d60fed1c for instance 695090ba-e147-4dee-b9e6-2a6050b3b776 on hv-cinder-81514 May 26 13:01:41.307493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-d0515ddd-ee0e-435f-967d-5d61334cd2e9 req-e70014ff-6a25-4c3e-8b3d-d08fafa44124 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034354 May 26 13:01:41.308007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 530/1035] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:01:41.341828 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56d1974d-150d-4d24-a6e5-2ab965e65196 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:41.351367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56d1974d-150d-4d24-a6e5-2ab965e65196 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.176193 May 26 13:01:41.351940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 506/1036] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:41 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:41.501523 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e534fe2-726e-4973-820a-a3fb19356337 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:41.502305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e534fe2-726e-4973-820a-a3fb19356337 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:41.508752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e534fe2-726e-4973-820a-a3fb19356337 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:41.509201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e534fe2-726e-4973-820a-a3fb19356337 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:41.509962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e534fe2-726e-4973-820a-a3fb19356337 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:41.510474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e534fe2-726e-4973-820a-a3fb19356337 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:41.646930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9e534fe2-726e-4973-820a-a3fb19356337 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:41.654952 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e534fe2-726e-4973-820a-a3fb19356337 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.158102 May 26 13:01:41.655517 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 531/1037] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:41 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:42.369673 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4742be91-0f1f-418a-9101-a445e80c16aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:42.370296 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4742be91-0f1f-418a-9101-a445e80c16aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:42.376895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4742be91-0f1f-418a-9101-a445e80c16aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:42.377346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4742be91-0f1f-418a-9101-a445e80c16aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:42.378369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4742be91-0f1f-418a-9101-a445e80c16aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:42.378843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4742be91-0f1f-418a-9101-a445e80c16aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:42.507379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4742be91-0f1f-418a-9101-a445e80c16aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:42.515307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4742be91-0f1f-418a-9101-a445e80c16aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.149746 May 26 13:01:42.515862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 507/1038] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:42 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:42.672945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-787b2047-a318-435a-8289-afff3065533b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:42.673561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-787b2047-a318-435a-8289-afff3065533b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:42.680302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-787b2047-a318-435a-8289-afff3065533b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:42.680791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-787b2047-a318-435a-8289-afff3065533b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:42.681563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-787b2047-a318-435a-8289-afff3065533b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:42.682023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-787b2047-a318-435a-8289-afff3065533b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:42.820220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-787b2047-a318-435a-8289-afff3065533b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:42.827665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-787b2047-a318-435a-8289-afff3065533b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.158979 May 26 13:01:42.828237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 532/1039] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:42 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:43.533667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55effc64-d189-411a-a38e-a2c56d455990 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:43.534196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55effc64-d189-411a-a38e-a2c56d455990 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:43.541473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55effc64-d189-411a-a38e-a2c56d455990 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:43.541926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55effc64-d189-411a-a38e-a2c56d455990 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:43.542722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55effc64-d189-411a-a38e-a2c56d455990 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:43.543155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55effc64-d189-411a-a38e-a2c56d455990 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:43.673406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55effc64-d189-411a-a38e-a2c56d455990 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:43.681626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55effc64-d189-411a-a38e-a2c56d455990 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1722 microversion: 2.1 time: 0.152340 May 26 13:01:43.682224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 508/1040] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:43 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:43.844859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-88111fea-04cf-458a-821d-4d33074e40b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:43.845383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-88111fea-04cf-458a-821d-4d33074e40b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:43.852505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88111fea-04cf-458a-821d-4d33074e40b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:43.852965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88111fea-04cf-458a-821d-4d33074e40b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:43.853748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88111fea-04cf-458a-821d-4d33074e40b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:43.854195 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88111fea-04cf-458a-821d-4d33074e40b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:43.988665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-88111fea-04cf-458a-821d-4d33074e40b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:43.996590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-88111fea-04cf-458a-821d-4d33074e40b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1266 microversion: 2.1 time: 0.155715 May 26 13:01:43.997165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 533/1041] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:43 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:44.699479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a76e8375-bac5-46f9-874c-24584e1df0d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:44.729173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a76e8375-bac5-46f9-874c-24584e1df0d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:44.729173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=43 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:44.729173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a76e8375-bac5-46f9-874c-24584e1df0d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:44.729173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a76e8375-bac5-46f9-874c-24584e1df0d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:44.729173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a76e8375-bac5-46f9-874c-24584e1df0d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:44.729895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a76e8375-bac5-46f9-874c-24584e1df0d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:44.840373 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a76e8375-bac5-46f9-874c-24584e1df0d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:44.848234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a76e8375-bac5-46f9-874c-24584e1df0d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1699 microversion: 2.1 time: 0.152596 May 26 13:01:44.849638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 509/1042] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:44 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:44.865472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7ad7f3a0-c14a-45f6-ad4b-9c29e5f53d95 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:44.872550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ad7f3a0-c14a-45f6-ad4b-9c29e5f53d95 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:44.873005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ad7f3a0-c14a-45f6-ad4b-9c29e5f53d95 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:44.894665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7ad7f3a0-c14a-45f6-ad4b-9c29e5f53d95 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Going to try to start instance {{(pid=124831) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 13:01:45.013471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-753f645e-de35-42b4-8458-5f8ee78db862 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:45.014009 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-753f645e-de35-42b4-8458-5f8ee78db862 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:45.019987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-753f645e-de35-42b4-8458-5f8ee78db862 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:45.021655 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-753f645e-de35-42b4-8458-5f8ee78db862 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:45.022449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-753f645e-de35-42b4-8458-5f8ee78db862 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:45.022923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-753f645e-de35-42b4-8458-5f8ee78db862 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:45.026869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7ad7f3a0-c14a-45f6-ad4b-9c29e5f53d95 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/action" status: 202 len: 0 microversion: 2.1 time: 0.164933 May 26 13:01:45.027733 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 534/1043] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 13:01:44 2022] POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:01:45.036658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87af2205-033f-4ada-b53a-653fbf5731d9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:45.037372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87af2205-033f-4ada-b53a-653fbf5731d9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:45.044096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87af2205-033f-4ada-b53a-653fbf5731d9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:45.044600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87af2205-033f-4ada-b53a-653fbf5731d9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:45.045435 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87af2205-033f-4ada-b53a-653fbf5731d9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:45.045832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87af2205-033f-4ada-b53a-653fbf5731d9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:45.161222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-753f645e-de35-42b4-8458-5f8ee78db862 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:45.170580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-753f645e-de35-42b4-8458-5f8ee78db862 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1453 microversion: 2.1 time: 0.161014 May 26 13:01:45.171157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 510/1044] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:45 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:01:45.187038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7dc76d87-2c1e-49ee-babe-c0016f9380fa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:45.187659 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7dc76d87-2c1e-49ee-babe-c0016f9380fa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:45.195913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc76d87-2c1e-49ee-babe-c0016f9380fa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:45.195913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc76d87-2c1e-49ee-babe-c0016f9380fa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:45.197579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-87af2205-033f-4ada-b53a-653fbf5731d9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:45.197733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc76d87-2c1e-49ee-babe-c0016f9380fa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:45.197733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc76d87-2c1e-49ee-babe-c0016f9380fa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:45.205056 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87af2205-033f-4ada-b53a-653fbf5731d9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1708 microversion: 2.1 time: 0.172570 May 26 13:01:45.206570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 535/1045] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:45 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1708 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:45.418674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7dc76d87-2c1e-49ee-babe-c0016f9380fa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:45.426040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7dc76d87-2c1e-49ee-babe-c0016f9380fa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1453 microversion: 2.1 time: 0.242851 May 26 13:01:45.427240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 511/1046] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:45 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1453 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:01:46.224462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6cc3cc2c-66ea-4ee0-9abb-ccf7ef5133d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:46.225169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6cc3cc2c-66ea-4ee0-9abb-ccf7ef5133d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:46.231744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cc3cc2c-66ea-4ee0-9abb-ccf7ef5133d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:46.232193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cc3cc2c-66ea-4ee0-9abb-ccf7ef5133d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:46.233015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cc3cc2c-66ea-4ee0-9abb-ccf7ef5133d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:46.233455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cc3cc2c-66ea-4ee0-9abb-ccf7ef5133d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:46.475608 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6cc3cc2c-66ea-4ee0-9abb-ccf7ef5133d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:46.483860 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6cc3cc2c-66ea-4ee0-9abb-ccf7ef5133d0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1708 microversion: 2.1 time: 0.263896 May 26 13:01:46.484532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 536/1047] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:46 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1708 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:47.507248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6fb7623-15ac-422f-8807-dcbde08e91f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:47.507248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6fb7623-15ac-422f-8807-dcbde08e91f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:47.510206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6fb7623-15ac-422f-8807-dcbde08e91f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:47.510940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6fb7623-15ac-422f-8807-dcbde08e91f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:47.511923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6fb7623-15ac-422f-8807-dcbde08e91f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:47.512552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6fb7623-15ac-422f-8807-dcbde08e91f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:47.673457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-2dc5d8fd-a858-48af-a2e8-6252ace2bfcf req-249afcaa-5f7f-41fb-a393-1509b5ea9ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695090ba-e147-4dee-b9e6-2a6050b3b776", "tag": "286a8e35-ed65-49e9-8076-5424d60fed1c"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:47.680854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-2dc5d8fd-a858-48af-a2e8-6252ace2bfcf req-249afcaa-5f7f-41fb-a393-1509b5ea9ebe service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:47.681568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-2dc5d8fd-a858-48af-a2e8-6252ace2bfcf req-249afcaa-5f7f-41fb-a393-1509b5ea9ebe service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:47.697457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-2dc5d8fd-a858-48af-a2e8-6252ace2bfcf req-249afcaa-5f7f-41fb-a393-1509b5ea9ebe service nova] Creating event network-changed:286a8e35-ed65-49e9-8076-5424d60fed1c for instance 695090ba-e147-4dee-b9e6-2a6050b3b776 on hv-cinder-81514 May 26 13:01:47.702310 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-2dc5d8fd-a858-48af-a2e8-6252ace2bfcf req-249afcaa-5f7f-41fb-a393-1509b5ea9ebe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100314 May 26 13:01:47.703038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 537/1048] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:01:47.745859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6fb7623-15ac-422f-8807-dcbde08e91f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:47.755643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6fb7623-15ac-422f-8807-dcbde08e91f0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1712 microversion: 2.1 time: 0.256365 May 26 13:01:47.767581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 512/1049] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:01:47 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1712 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:53.329530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:01:53.330000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:02:37.957310 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:02:37.957966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:02:45.130022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:02:45.130801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:02:45.134987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-30a97d94-11c6-4230-9422-04c2b7f7c336 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:45.135574 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-30a97d94-11c6-4230-9422-04c2b7f7c336 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:45.142165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30a97d94-11c6-4230-9422-04c2b7f7c336 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:45.152103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30a97d94-11c6-4230-9422-04c2b7f7c336 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:45.152103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30a97d94-11c6-4230-9422-04c2b7f7c336 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:45.152103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30a97d94-11c6-4230-9422-04c2b7f7c336 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:45.325087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-30a97d94-11c6-4230-9422-04c2b7f7c336 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lazy-loading 'services' on Instance uuid 53635b2e-ae71-4639-b46e-f532ce5708a5 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:02:45.535975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-30a97d94-11c6-4230-9422-04c2b7f7c336 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/os-volume_attachments/6e91d5b3-9f45-4544-a196-a900300a203c" status: 202 len: 0 microversion: 2.1 time: 0.407438 May 26 13:02:45.536572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 538/1050] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 13:02:45 2022] DELETE /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/os-volume_attachments/6e91d5b3-9f45-4544-a196-a900300a203c => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:02:47.698694 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=7 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:02:47.699471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=46 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:02:47.703475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef59a83a-9c89-4f7c-adf4-7d3c985983e1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:02:47.710730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef59a83a-9c89-4f7c-adf4-7d3c985983e1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:47.711185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef59a83a-9c89-4f7c-adf4-7d3c985983e1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:47.773512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef59a83a-9c89-4f7c-adf4-7d3c985983e1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Going to try to stop instance {{(pid=124830) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 13:02:47.924969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef59a83a-9c89-4f7c-adf4-7d3c985983e1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/action" status: 202 len: 0 microversion: 2.1 time: 0.227751 May 26 13:02:47.925910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 513/1051] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 13:02:47 2022] POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:02:47.935165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e4a8faa9-f3a5-4a00-a8be-86bab82139a7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:47.935877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e4a8faa9-f3a5-4a00-a8be-86bab82139a7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:47.943027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4a8faa9-f3a5-4a00-a8be-86bab82139a7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:47.943484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4a8faa9-f3a5-4a00-a8be-86bab82139a7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:47.944262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4a8faa9-f3a5-4a00-a8be-86bab82139a7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:47.944705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4a8faa9-f3a5-4a00-a8be-86bab82139a7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:48.113841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e4a8faa9-f3a5-4a00-a8be-86bab82139a7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:48.121655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e4a8faa9-f3a5-4a00-a8be-86bab82139a7 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.191348 May 26 13:02:48.122229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 539/1052] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:47 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:49.139565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-58f3bf02-8b2c-4a5e-a933-9e83a53ed160 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:49.140263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-58f3bf02-8b2c-4a5e-a933-9e83a53ed160 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:49.147361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58f3bf02-8b2c-4a5e-a933-9e83a53ed160 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:49.147806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58f3bf02-8b2c-4a5e-a933-9e83a53ed160 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:49.148564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58f3bf02-8b2c-4a5e-a933-9e83a53ed160 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:49.148995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58f3bf02-8b2c-4a5e-a933-9e83a53ed160 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:49.333309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-58f3bf02-8b2c-4a5e-a933-9e83a53ed160 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:49.340869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-58f3bf02-8b2c-4a5e-a933-9e83a53ed160 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.205490 May 26 13:02:49.341542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 514/1053] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:49 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:50.360820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-51942124-0380-4119-8bb3-f36a2a5a91aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:50.361565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-51942124-0380-4119-8bb3-f36a2a5a91aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:50.369490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51942124-0380-4119-8bb3-f36a2a5a91aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:50.369949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51942124-0380-4119-8bb3-f36a2a5a91aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:50.370753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51942124-0380-4119-8bb3-f36a2a5a91aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:50.371195 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51942124-0380-4119-8bb3-f36a2a5a91aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:50.512440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51942124-0380-4119-8bb3-f36a2a5a91aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:50.519959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-51942124-0380-4119-8bb3-f36a2a5a91aa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.163816 May 26 13:02:50.520528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 540/1054] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:50 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:51.537008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff271096-e7a8-4655-8078-0689c10ca497 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:51.537564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff271096-e7a8-4655-8078-0689c10ca497 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:51.544026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff271096-e7a8-4655-8078-0689c10ca497 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:51.544505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff271096-e7a8-4655-8078-0689c10ca497 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:51.545269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff271096-e7a8-4655-8078-0689c10ca497 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:51.545706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff271096-e7a8-4655-8078-0689c10ca497 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:51.681201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff271096-e7a8-4655-8078-0689c10ca497 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:51.689415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff271096-e7a8-4655-8078-0689c10ca497 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.156610 May 26 13:02:51.689972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 515/1055] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:51 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:52.707279 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eff7e449-8135-4e2c-8ac0-96e3f4e6f525 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:52.707911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eff7e449-8135-4e2c-8ac0-96e3f4e6f525 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:52.714425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eff7e449-8135-4e2c-8ac0-96e3f4e6f525 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:52.714955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eff7e449-8135-4e2c-8ac0-96e3f4e6f525 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:52.715718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eff7e449-8135-4e2c-8ac0-96e3f4e6f525 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:52.716153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eff7e449-8135-4e2c-8ac0-96e3f4e6f525 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:52.843311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eff7e449-8135-4e2c-8ac0-96e3f4e6f525 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:52.850808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eff7e449-8135-4e2c-8ac0-96e3f4e6f525 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.147950 May 26 13:02:52.851376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 541/1056] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:52 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:53.867627 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d12ae9a3-d892-4a9b-a7de-6be35d2967b9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:53.868242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d12ae9a3-d892-4a9b-a7de-6be35d2967b9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:53.874675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d12ae9a3-d892-4a9b-a7de-6be35d2967b9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:53.875123 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d12ae9a3-d892-4a9b-a7de-6be35d2967b9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:53.876374 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d12ae9a3-d892-4a9b-a7de-6be35d2967b9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:53.876828 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d12ae9a3-d892-4a9b-a7de-6be35d2967b9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:54.002623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d12ae9a3-d892-4a9b-a7de-6be35d2967b9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:54.010157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d12ae9a3-d892-4a9b-a7de-6be35d2967b9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.146406 May 26 13:02:54.010791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 516/1057] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:53 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:55.027259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-670f56cd-1645-4722-9f08-03055ea51ba1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:55.027875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-670f56cd-1645-4722-9f08-03055ea51ba1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:55.035023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670f56cd-1645-4722-9f08-03055ea51ba1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:55.035479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670f56cd-1645-4722-9f08-03055ea51ba1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:55.036241 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670f56cd-1645-4722-9f08-03055ea51ba1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:55.036678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670f56cd-1645-4722-9f08-03055ea51ba1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:55.167362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-670f56cd-1645-4722-9f08-03055ea51ba1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:55.175282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-670f56cd-1645-4722-9f08-03055ea51ba1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.151864 May 26 13:02:55.175840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 542/1058] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:55 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:56.193322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-834811dc-0af2-4d15-8f0a-d65accd0399c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:56.193921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-834811dc-0af2-4d15-8f0a-d65accd0399c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:56.200343 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-834811dc-0af2-4d15-8f0a-d65accd0399c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:56.200790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-834811dc-0af2-4d15-8f0a-d65accd0399c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:56.201545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-834811dc-0af2-4d15-8f0a-d65accd0399c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:56.201980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-834811dc-0af2-4d15-8f0a-d65accd0399c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:56.332847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-834811dc-0af2-4d15-8f0a-d65accd0399c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:56.340243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-834811dc-0af2-4d15-8f0a-d65accd0399c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.150872 May 26 13:02:56.340797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 517/1059] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:56 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:57.357806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-156f5e13-4988-4501-88e2-1b845d03da9d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:57.358425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-156f5e13-4988-4501-88e2-1b845d03da9d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:57.365167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-156f5e13-4988-4501-88e2-1b845d03da9d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:57.365624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-156f5e13-4988-4501-88e2-1b845d03da9d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:57.366420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-156f5e13-4988-4501-88e2-1b845d03da9d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:57.366892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-156f5e13-4988-4501-88e2-1b845d03da9d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:57.494261 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-156f5e13-4988-4501-88e2-1b845d03da9d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:57.502810 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-156f5e13-4988-4501-88e2-1b845d03da9d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1676 microversion: 2.1 time: 0.148828 May 26 13:02:57.503383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 543/1060] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:57 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:58.520008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-990d4028-31f1-401e-ad01-50e7797c47b4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:58.520616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-990d4028-31f1-401e-ad01-50e7797c47b4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:58.527407 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-990d4028-31f1-401e-ad01-50e7797c47b4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:58.527894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-990d4028-31f1-401e-ad01-50e7797c47b4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:58.528669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-990d4028-31f1-401e-ad01-50e7797c47b4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:58.529109 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-990d4028-31f1-401e-ad01-50e7797c47b4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:58.664082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-990d4028-31f1-401e-ad01-50e7797c47b4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:58.671692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-990d4028-31f1-401e-ad01-50e7797c47b4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1653 microversion: 2.1 time: 0.155692 May 26 13:02:58.675238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 518/1061] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:58 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:02:58.688945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7cc47dc0-0944-4ca9-938f-cf520045651a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:02:58.695012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cc47dc0-0944-4ca9-938f-cf520045651a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:58.695469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cc47dc0-0944-4ca9-938f-cf520045651a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:58.719201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7cc47dc0-0944-4ca9-938f-cf520045651a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Going to try to start instance {{(pid=124831) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 13:02:58.917806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7cc47dc0-0944-4ca9-938f-cf520045651a tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/action" status: 202 len: 0 microversion: 2.1 time: 0.232669 May 26 13:02:58.918439 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 544/1062] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 26 13:02:58 2022] POST /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:02:58.927480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f602cb6-6f73-42e7-8046-5bc6016d0204 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:02:58.931558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f602cb6-6f73-42e7-8046-5bc6016d0204 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:02:58.934256 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f602cb6-6f73-42e7-8046-5bc6016d0204 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:58.934747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f602cb6-6f73-42e7-8046-5bc6016d0204 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:58.935527 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f602cb6-6f73-42e7-8046-5bc6016d0204 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:02:58.935970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f602cb6-6f73-42e7-8046-5bc6016d0204 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:02:59.064806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2f602cb6-6f73-42e7-8046-5bc6016d0204 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:02:59.073608 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f602cb6-6f73-42e7-8046-5bc6016d0204 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1662 microversion: 2.1 time: 0.150923 May 26 13:02:59.074172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 519/1063] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:02:58 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:03:00.093323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8960f3e2-2dbb-4ab7-b8c5-0b6986287c02 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:03:00.093950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8960f3e2-2dbb-4ab7-b8c5-0b6986287c02 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:03:00.101050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8960f3e2-2dbb-4ab7-b8c5-0b6986287c02 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:03:00.101509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8960f3e2-2dbb-4ab7-b8c5-0b6986287c02 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:03:00.102283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8960f3e2-2dbb-4ab7-b8c5-0b6986287c02 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:03:00.102763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8960f3e2-2dbb-4ab7-b8c5-0b6986287c02 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:03:00.229917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8960f3e2-2dbb-4ab7-b8c5-0b6986287c02 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:03:00.237651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8960f3e2-2dbb-4ab7-b8c5-0b6986287c02 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1662 microversion: 2.1 time: 0.149277 May 26 13:03:00.238226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 545/1064] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:03:00 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:03:01.255369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0c4b2f89-810a-4c58-9154-d7c9ba4b9625 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:03:01.255915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0c4b2f89-810a-4c58-9154-d7c9ba4b9625 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:03:01.262398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c4b2f89-810a-4c58-9154-d7c9ba4b9625 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:03:01.262876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c4b2f89-810a-4c58-9154-d7c9ba4b9625 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:03:01.263640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c4b2f89-810a-4c58-9154-d7c9ba4b9625 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:03:01.264075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c4b2f89-810a-4c58-9154-d7c9ba4b9625 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:03:01.395036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0c4b2f89-810a-4c58-9154-d7c9ba4b9625 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:03:01.402437 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0c4b2f89-810a-4c58-9154-d7c9ba4b9625 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1666 microversion: 2.1 time: 0.150981 May 26 13:03:01.403029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 520/1065] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:03:01 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:03.883149 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0c7708d-1d8c-4aa2-941b-bcfe0bcbe652 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:03.883758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0c7708d-1d8c-4aa2-941b-bcfe0bcbe652 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:03.886459 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=16 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:03.887263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:03.892207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0c7708d-1d8c-4aa2-941b-bcfe0bcbe652 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:03.892665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0c7708d-1d8c-4aa2-941b-bcfe0bcbe652 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:03.893455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0c7708d-1d8c-4aa2-941b-bcfe0bcbe652 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:03.893903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0c7708d-1d8c-4aa2-941b-bcfe0bcbe652 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:03.920036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0c7708d-1d8c-4aa2-941b-bcfe0bcbe652 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:04:04.227452 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a0c7708d-1d8c-4aa2-941b-bcfe0bcbe652 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "DELETE /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 204 len: 0 microversion: 2.1 time: 0.349461 May 26 13:04:04.228576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 546/1066] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:04:03 2022] DELETE /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:04:04.235722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=16 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:04.236560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:04.240713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5d2adf2-5f25-4461-8cc5-b971dd1174dc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:04.241439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5d2adf2-5f25-4461-8cc5-b971dd1174dc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:04.250146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5d2adf2-5f25-4461-8cc5-b971dd1174dc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:04.250743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5d2adf2-5f25-4461-8cc5-b971dd1174dc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:04.251549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5d2adf2-5f25-4461-8cc5-b971dd1174dc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:04.251990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5d2adf2-5f25-4461-8cc5-b971dd1174dc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:04.393272 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5d2adf2-5f25-4461-8cc5-b971dd1174dc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:04.400710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5d2adf2-5f25-4461-8cc5-b971dd1174dc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1578 microversion: 2.1 time: 0.166977 May 26 13:04:04.401210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 521/1067] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:04 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:04.718153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a2c92a9-8452-43cb-82c8-d21a2a975e23 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:04.719267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a2c92a9-8452-43cb-82c8-d21a2a975e23 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:04.725418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a2c92a9-8452-43cb-82c8-d21a2a975e23 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:04.725862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a2c92a9-8452-43cb-82c8-d21a2a975e23 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:04.726675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a2c92a9-8452-43cb-82c8-d21a2a975e23 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:04.727109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a2c92a9-8452-43cb-82c8-d21a2a975e23 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:04.757715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a2c92a9-8452-43cb-82c8-d21a2a975e23 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044202 May 26 13:04:04.758276 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 547/1068] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 13:04:04 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:04:04.819326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a83f6650-bce6-4929-a91c-5f64f45ef760 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:04.819830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a83f6650-bce6-4929-a91c-5f64f45ef760 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:04.827489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a83f6650-bce6-4929-a91c-5f64f45ef760 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:04.828623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a83f6650-bce6-4929-a91c-5f64f45ef760 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:04.828774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a83f6650-bce6-4929-a91c-5f64f45ef760 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:04.829137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a83f6650-bce6-4929-a91c-5f64f45ef760 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:04.857112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a83f6650-bce6-4929-a91c-5f64f45ef760 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:04:05.124039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a83f6650-bce6-4929-a91c-5f64f45ef760 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 204 len: 0 microversion: 2.1 time: 0.308235 May 26 13:04:05.124631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 522/1069] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:04:04 2022] DELETE /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 13:04:05.132800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2cdbf3d2-4812-4f89-8e06-94867884600f tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:05.133419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2cdbf3d2-4812-4f89-8e06-94867884600f tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:05.140784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cdbf3d2-4812-4f89-8e06-94867884600f tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:05.141234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cdbf3d2-4812-4f89-8e06-94867884600f tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:05.142013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cdbf3d2-4812-4f89-8e06-94867884600f tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:05.142457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cdbf3d2-4812-4f89-8e06-94867884600f tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:05.294257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2cdbf3d2-4812-4f89-8e06-94867884600f tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:05.301977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2cdbf3d2-4812-4f89-8e06-94867884600f tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1672 microversion: 2.1 time: 0.173019 May 26 13:04:05.302571 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 548/1070] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:05 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:05.419710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-84424219-d4ae-419b-b90f-4a95ebee1fbe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:05.420372 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-84424219-d4ae-419b-b90f-4a95ebee1fbe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:05.426988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84424219-d4ae-419b-b90f-4a95ebee1fbe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:05.427461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84424219-d4ae-419b-b90f-4a95ebee1fbe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:05.428220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84424219-d4ae-419b-b90f-4a95ebee1fbe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:05.428658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84424219-d4ae-419b-b90f-4a95ebee1fbe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:05.579154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84424219-d4ae-419b-b90f-4a95ebee1fbe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:05.586750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-84424219-d4ae-419b-b90f-4a95ebee1fbe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1578 microversion: 2.1 time: 0.172682 May 26 13:04:05.587321 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 523/1071] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:05 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:06.320047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49e728a6-32f0-4646-bd4b-684f66df9320 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:06.320663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49e728a6-32f0-4646-bd4b-684f66df9320 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:06.328034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49e728a6-32f0-4646-bd4b-684f66df9320 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:06.328548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49e728a6-32f0-4646-bd4b-684f66df9320 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:06.329329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49e728a6-32f0-4646-bd4b-684f66df9320 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:06.329772 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49e728a6-32f0-4646-bd4b-684f66df9320 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:06.469705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49e728a6-32f0-4646-bd4b-684f66df9320 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:06.477352 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49e728a6-32f0-4646-bd4b-684f66df9320 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1672 microversion: 2.1 time: 0.161170 May 26 13:04:06.477929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 549/1072] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:06 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:06.606697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9d4f6957-9817-4707-939d-5037a555adea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:06.607290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9d4f6957-9817-4707-939d-5037a555adea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:06.617676 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d4f6957-9817-4707-939d-5037a555adea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:06.618130 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d4f6957-9817-4707-939d-5037a555adea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:06.619610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d4f6957-9817-4707-939d-5037a555adea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:06.620074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d4f6957-9817-4707-939d-5037a555adea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:06.768816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d4f6957-9817-4707-939d-5037a555adea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:06.776555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9d4f6957-9817-4707-939d-5037a555adea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1578 microversion: 2.1 time: 0.176207 May 26 13:04:06.777125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 524/1073] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:06 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:07.495918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-702150fc-e3f1-4d6b-9eb4-fab8d837f30d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:07.496474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-702150fc-e3f1-4d6b-9eb4-fab8d837f30d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:07.503524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-702150fc-e3f1-4d6b-9eb4-fab8d837f30d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:07.503979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-702150fc-e3f1-4d6b-9eb4-fab8d837f30d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:07.504760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-702150fc-e3f1-4d6b-9eb4-fab8d837f30d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:07.505199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-702150fc-e3f1-4d6b-9eb4-fab8d837f30d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:07.656587 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-702150fc-e3f1-4d6b-9eb4-fab8d837f30d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:07.665866 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-702150fc-e3f1-4d6b-9eb4-fab8d837f30d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1672 microversion: 2.1 time: 0.173733 May 26 13:04:07.667502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 550/1074] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:07 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:07.794778 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fe74f559-2075-44db-9442-cdab0c223ce0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:07.795413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fe74f559-2075-44db-9442-cdab0c223ce0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:07.803198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe74f559-2075-44db-9442-cdab0c223ce0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:07.803648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe74f559-2075-44db-9442-cdab0c223ce0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:07.804418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe74f559-2075-44db-9442-cdab0c223ce0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:07.804855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe74f559-2075-44db-9442-cdab0c223ce0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:07.952837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fe74f559-2075-44db-9442-cdab0c223ce0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:07.960538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fe74f559-2075-44db-9442-cdab0c223ce0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1578 microversion: 2.1 time: 0.170525 May 26 13:04:07.961117 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 525/1075] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:07 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:08.699277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bcc2373a-b914-4648-a827-07ea778dd872 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:08.704378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bcc2373a-b914-4648-a827-07ea778dd872 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:08.725426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcc2373a-b914-4648-a827-07ea778dd872 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:08.729856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcc2373a-b914-4648-a827-07ea778dd872 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:08.729856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcc2373a-b914-4648-a827-07ea778dd872 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:08.729856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcc2373a-b914-4648-a827-07ea778dd872 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:08.848704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcc2373a-b914-4648-a827-07ea778dd872 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:08.856791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bcc2373a-b914-4648-a827-07ea778dd872 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1605 microversion: 2.1 time: 0.167264 May 26 13:04:08.857472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 551/1076] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:08 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:08.981964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34408b23-de9c-49e7-b042-a14f5450eecc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:08.986375 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34408b23-de9c-49e7-b042-a14f5450eecc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:08.990399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34408b23-de9c-49e7-b042-a14f5450eecc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:08.991132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34408b23-de9c-49e7-b042-a14f5450eecc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:08.992408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34408b23-de9c-49e7-b042-a14f5450eecc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:08.993227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34408b23-de9c-49e7-b042-a14f5450eecc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:09.013467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-ff3cbae6-6857-4173-9eac-79576a12039e req-4884e15f-5a6f-40b2-a7bc-f9a4a3736c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695090ba-e147-4dee-b9e6-2a6050b3b776", "name": "network-vif-deleted", "tag": "286a8e35-ed65-49e9-8076-5424d60fed1c"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:09.028134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ff3cbae6-6857-4173-9eac-79576a12039e req-4884e15f-5a6f-40b2-a7bc-f9a4a3736c2b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:09.028588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ff3cbae6-6857-4173-9eac-79576a12039e req-4884e15f-5a6f-40b2-a7bc-f9a4a3736c2b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:09.061033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-ff3cbae6-6857-4173-9eac-79576a12039e req-4884e15f-5a6f-40b2-a7bc-f9a4a3736c2b service nova] Creating event network-vif-deleted:286a8e35-ed65-49e9-8076-5424d60fed1c for instance 695090ba-e147-4dee-b9e6-2a6050b3b776 on hv-cinder-81514 May 26 13:04:09.083980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-ff3cbae6-6857-4173-9eac-79576a12039e req-4884e15f-5a6f-40b2-a7bc-f9a4a3736c2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067143 May 26 13:04:09.092823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 552/1077] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:04:09.184619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34408b23-de9c-49e7-b042-a14f5450eecc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:09.193128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-5e0ef7a1-81e2-4ccb-a70b-91a48c6bb03b req-ff133962-3990-4d62-90f4-c6fc3851b46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53635b2e-ae71-4639-b46e-f532ce5708a5", "name": "network-vif-deleted", "tag": "0e88b927-d546-4d09-ad0e-c13eb3a0beb2"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:09.209877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34408b23-de9c-49e7-b042-a14f5450eecc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1510 microversion: 2.1 time: 0.231074 May 26 13:04:09.209877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 526/1078] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:08 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:04:09.227710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5e0ef7a1-81e2-4ccb-a70b-91a48c6bb03b req-ff133962-3990-4d62-90f4-c6fc3851b46a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:09.229414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5e0ef7a1-81e2-4ccb-a70b-91a48c6bb03b req-ff133962-3990-4d62-90f4-c6fc3851b46a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:09.280697 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-5e0ef7a1-81e2-4ccb-a70b-91a48c6bb03b req-ff133962-3990-4d62-90f4-c6fc3851b46a service nova] Creating event network-vif-deleted:0e88b927-d546-4d09-ad0e-c13eb3a0beb2 for instance 53635b2e-ae71-4639-b46e-f532ce5708a5 on hv-cinder-81514 May 26 13:04:09.294290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-5e0ef7a1-81e2-4ccb-a70b-91a48c6bb03b req-ff133962-3990-4d62-90f4-c6fc3851b46a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106362 May 26 13:04:09.295679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 553/1079] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:04:09.875522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:09.876313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:09.883432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:09.884206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:09.886417 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:09.887107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:09.924826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:09.925280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:09.925760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lazy-loading 'fault' on Instance uuid 53635b2e-ae71-4639-b46e-f532ce5708a5 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:04:09.977239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:09.987159 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e95d060-466f-4b59-9282-8568c07a3343 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 200 len: 1327 microversion: 2.1 time: 0.115612 May 26 13:04:09.988748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 527/1080] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:09 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:10.229776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:10.230499 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:10.237620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:10.238070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:10.238887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:10.239324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:10.281079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:10.281805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:10.282436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lazy-loading 'fault' on Instance uuid 695090ba-e147-4dee-b9e6-2a6050b3b776 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:04:10.341067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:10.351073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8ad9e3ab-2598-453d-8cca-ef2eed22bf2c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 200 len: 1230 microversion: 2.1 time: 0.127526 May 26 13:04:10.352250 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 554/1081] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:10 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 1230 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:11.007208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:11.008265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:11.017600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:11.018246 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:11.019071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:11.019511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:11.035992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] HTTP exception thrown: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Request method failure captured: May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 HTTP/1.1 May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3mrBCuMbUmGEaNCFWwbD98iS17kNT3A53idf9LjJDiNh-vJSPU4zelMQnyyCsw60mBzqwkNJco3fAc-7Mo9KsT64A9aEtM-m_fE4xgWnwBEnnHJV6tYnXQrl9n16C9Clj3BD9OjSqGP2PN3UMLmfsJbgZJDD8heJ7RwSxrUE3v1Kag May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 13:04:11.037645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeTestJSON-160524813 May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeTestJSON-160524813-project May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 563aa380be524bc7970d486ce9ae82c7 May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeTestJSON-160524813-project May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:04:11.040327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '53635b2e-ae71-4639-b46e-f532ce5708a5'} May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:04:11.042578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:04:11.045314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.047864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Returning 404 to user: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:04:11.047864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-33707574-cdcb-4659-825a-98ee913b3114 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 404 len: 111 microversion: 2.1 time: 0.036566 May 26 13:04:11.047864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 528/1082] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:11 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:04:11.050639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31e7d955-c6c6-45d4-a845-e41d8e34481d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '.version_select at 0x7f498c0c4dc0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:11.133392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31e7d955-c6c6-45d4-a845-e41d8e34481d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783724108" status: 202 len: 0 microversion: 2.1 time: 0.088116 May 26 13:04:11.133977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 555/1083] 10.222.0.60 () {58 vars in 1217 bytes} [Thu May 26 13:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783724108 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:04:11.374977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:11.376215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:11.391368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:11.392578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:11.394297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:11.395219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:11.426738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] HTTP exception thrown: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Request method failure captured: May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 HTTP/1.1 May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3oESiUfmslR-aYErDpKWpE09Ef8nhu8FvRKtodSjsoPVTBpZ9Hoo7lD5Q8btUXBQgvrBMf1fXC9hxYBT-mt2d5yat6w7PYE_7U36wW5HGMDTXB4Ih3ZUGpdspGdXteSAoeyjSzJ81AkSlMz_BmYtgrd5GOBm3Cv8dkpK8ie84b6T80 May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 2bbaabf20652434cb79e0652ec678fbb May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestVolumeBootPattern-416956949 May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 13:04:11.429912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestVolumeBootPattern-416956949 May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 2bbaabf20652434cb79e0652ec678fbb May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestVolumeBootPattern-416956949 May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-TestVolumeBootPattern-416956949-project May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 491ef95e936943d5a144876c2fe22eaf May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestVolumeBootPattern-416956949-project May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:04:11.431910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '695090ba-e147-4dee-b9e6-2a6050b3b776'} May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:04:11.432890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:04:11.434423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:04:11.435716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Returning 404 to user: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:04:11.435716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aafcf472-6049-4359-b29e-7bf2447d3b99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 404 len: 111 microversion: 2.1 time: 0.068159 May 26 13:04:11.435716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 529/1084] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:11 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:04:11.482801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-252043188", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-193225139", "security_groups": [{"name": "tempest-secgroup-smoke-2017732673"}], "block_device_mapping_v2": [{"uuid": "938ec072-9a0f-46be-b5f9-e065e99730c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d5d8628a-f8b7-48d9-9cb6-83fd3ac6436c"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:11.604474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] validate_networks() for [('d5d8628a-f8b7-48d9-9cb6-83fd3ac6436c', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:04:11.981415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4823ff9f-b551-4f0b-b0a5-320ce9aab8ae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'create', calling method: .version_select at 0x7f498c1f4430>, body: {"keypair": {"name": "tempest-keypair-878141295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5q9pPv/EXsJFSBY78kxMRs/85BmOcBK+rU3QJQYXxO89vlaMz7lUzjI16dnzOBMdrPLFzXG8jHxTpKHfERF27NPI/VXAq1Zg7sS9iIaJaRF2xJMR3camNtAB5UAa7T2A=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:11.996370 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-4823ff9f-b551-4f0b-b0a5-320ce9aab8ae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Getting quotas for project fcb152674fde4beebd5a106495b1ab2c. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:04:12.000414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-4823ff9f-b551-4f0b-b0a5-320ce9aab8ae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Getting quotas for user 563aa380be524bc7970d486ce9ae82c7 and project fcb152674fde4beebd5a106495b1ab2c. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:04:12.032878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:04:12.033613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:04:12.034453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:04:12.035292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:04:12.036059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:04:12.048895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:12.049287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:12.050599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:12.051041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:12.071229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Getting quotas for project 2bbaabf20652434cb79e0652ec678fbb. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:04:12.075572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Getting quotas for user 491ef95e936943d5a144876c2fe22eaf and project 2bbaabf20652434cb79e0652ec678fbb. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:04:12.095437 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4823ff9f-b551-4f0b-b0a5-320ce9aab8ae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118597 May 26 13:04:12.101132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 530/1085] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 26 13:04:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:04:12.136073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:04:12.138171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='938ec072-9a0f-46be-b5f9-e065e99730c9',volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:04:12.605532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [8b369ab4-8635-459d-bab8-6555c60d0b13] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 13:04:13.613474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [8b369ab4-8635-459d-bab8-6555c60d0b13] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 52038. May 26 13:04:13.619059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4167cc3c-2b22-4d8a-95cd-62f84f45f271 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.141933 May 26 13:04:13.620272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 556/1086] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 13:04:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:04:13.631476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-026bbbe4-b73a-4d54-a306-76c3fe06f958 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:13.632275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-026bbbe4-b73a-4d54-a306-76c3fe06f958 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:13.898851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-026bbbe4-b73a-4d54-a306-76c3fe06f958 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:13.910809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-026bbbe4-b73a-4d54-a306-76c3fe06f958 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1093 microversion: 2.1 time: 0.283406 May 26 13:04:13.911703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 531/1087] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:13 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1093 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:14.938423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec1e55b2-f0ee-43bf-b040-cbecbc915bc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:14.939498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec1e55b2-f0ee-43bf-b040-cbecbc915bc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:14.946503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec1e55b2-f0ee-43bf-b040-cbecbc915bc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:14.947072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec1e55b2-f0ee-43bf-b040-cbecbc915bc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:14.951112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec1e55b2-f0ee-43bf-b040-cbecbc915bc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:14.951112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec1e55b2-f0ee-43bf-b040-cbecbc915bc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:15.025111 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-264837134", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41a238b9-8acb-4d3e-9125-ac98ac962e90"}], "security_groups": [{"name": "tempest-securitygroup--1317557646"}], "key_name": "tempest-keypair-878141295", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:15.029701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec1e55b2-f0ee-43bf-b040-cbecbc915bc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:15.045041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec1e55b2-f0ee-43bf-b040-cbecbc915bc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1135 microversion: 2.1 time: 0.114893 May 26 13:04:15.046565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 557/1088] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:14 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1135 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:04:15.146029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] validate_networks() for [('41a238b9-8acb-4d3e-9125-ac98ac962e90', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:04:15.626992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:04:15.627706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:04:15.628353 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:04:15.628770 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:04:15.629185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:04:15.640820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:15.641267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:15.642134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:15.642592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:15.660824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Getting quotas for project fcb152674fde4beebd5a106495b1ab2c. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:04:15.666805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Getting quotas for user 563aa380be524bc7970d486ce9ae82c7 and project fcb152674fde4beebd5a106495b1ab2c. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:04:15.680200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:04:15.683476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:04:15.843933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56de5c0f-5a45-42d5-acab-5c1a19a2b4f4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.822999 May 26 13:04:15.852266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 532/1089] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 13:04:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:04:15.858994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aa568178-f9a8-4cbf-8638-6dc7e9e568ab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:15.859731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aa568178-f9a8-4cbf-8638-6dc7e9e568ab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:15.943359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa568178-f9a8-4cbf-8638-6dc7e9e568ab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:15.950584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aa568178-f9a8-4cbf-8638-6dc7e9e568ab tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1236 microversion: 2.1 time: 0.096400 May 26 13:04:15.951208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 558/1090] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:15 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:16.069149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-18d717e4-c6b7-4043-afae-1bee906e99a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:16.069993 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-18d717e4-c6b7-4043-afae-1bee906e99a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:16.079528 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18d717e4-c6b7-4043-afae-1bee906e99a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:16.080280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18d717e4-c6b7-4043-afae-1bee906e99a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:16.081075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18d717e4-c6b7-4043-afae-1bee906e99a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:16.081522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18d717e4-c6b7-4043-afae-1bee906e99a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:16.154677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-18d717e4-c6b7-4043-afae-1bee906e99a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:16.162576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-18d717e4-c6b7-4043-afae-1bee906e99a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1209 microversion: 2.1 time: 0.098840 May 26 13:04:16.163360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 533/1091] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:16 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:16.967840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1700082a-120c-43e8-85c6-532626d065b6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:16.969226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1700082a-120c-43e8-85c6-532626d065b6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:17.051072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1700082a-120c-43e8-85c6-532626d065b6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:17.059695 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1700082a-120c-43e8-85c6-532626d065b6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1236 microversion: 2.1 time: 0.096224 May 26 13:04:17.060286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 559/1092] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:16 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:17.185244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31fa5312-9c9e-42f5-a44e-f3aebb85a7ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:17.186495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31fa5312-9c9e-42f5-a44e-f3aebb85a7ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:17.193591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31fa5312-9c9e-42f5-a44e-f3aebb85a7ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:17.194162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31fa5312-9c9e-42f5-a44e-f3aebb85a7ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:17.195178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31fa5312-9c9e-42f5-a44e-f3aebb85a7ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:17.195777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31fa5312-9c9e-42f5-a44e-f3aebb85a7ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:17.342214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31fa5312-9c9e-42f5-a44e-f3aebb85a7ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:17.349831 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31fa5312-9c9e-42f5-a44e-f3aebb85a7ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1277 microversion: 2.1 time: 0.173028 May 26 13:04:17.350401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 534/1093] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:17 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:17.855244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-d3e8f5f4-6467-43b0-9f7e-32874bf40966 req-520752b5-018c-4d38-b079-c6bb90e35451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d4069d-fe62-4f1e-b4ad-ed907dbf2b99", "tag": "bd3badd8-5652-406f-8c25-159b3d8554a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:17.865368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d3e8f5f4-6467-43b0-9f7e-32874bf40966 req-520752b5-018c-4d38-b079-c6bb90e35451 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:17.865658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d3e8f5f4-6467-43b0-9f7e-32874bf40966 req-520752b5-018c-4d38-b079-c6bb90e35451 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:17.879819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-d3e8f5f4-6467-43b0-9f7e-32874bf40966 req-520752b5-018c-4d38-b079-c6bb90e35451 service nova] Creating event network-changed:bd3badd8-5652-406f-8c25-159b3d8554a1 for instance 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 on hv-cinder-81514 May 26 13:04:17.886444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-d3e8f5f4-6467-43b0-9f7e-32874bf40966 req-520752b5-018c-4d38-b079-c6bb90e35451 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041272 May 26 13:04:17.887097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 560/1094] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:04:18.078895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-be40e1d8-361f-461c-805a-2063d7879f78 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:18.079526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-be40e1d8-361f-461c-805a-2063d7879f78 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:18.160555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-be40e1d8-361f-461c-805a-2063d7879f78 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:18.169374 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-be40e1d8-361f-461c-805a-2063d7879f78 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1236 microversion: 2.1 time: 0.096107 May 26 13:04:18.170283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 535/1095] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:18 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:18.368396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c6cdcfcc-db45-472c-96f3-707f8fef27a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:18.369040 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c6cdcfcc-db45-472c-96f3-707f8fef27a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:18.376422 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6cdcfcc-db45-472c-96f3-707f8fef27a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:18.376873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6cdcfcc-db45-472c-96f3-707f8fef27a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:18.377654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6cdcfcc-db45-472c-96f3-707f8fef27a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:18.378088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6cdcfcc-db45-472c-96f3-707f8fef27a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:18.632352 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c6cdcfcc-db45-472c-96f3-707f8fef27a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:18.641027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c6cdcfcc-db45-472c-96f3-707f8fef27a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.276858 May 26 13:04:18.641615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 561/1096] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:18 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:19.187651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f45fbec4-ffe0-407b-bb84-4f2fca923870 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:19.188271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f45fbec4-ffe0-407b-bb84-4f2fca923870 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:19.248877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f45fbec4-ffe0-407b-bb84-4f2fca923870 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:19.260325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f45fbec4-ffe0-407b-bb84-4f2fca923870 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1236 microversion: 2.1 time: 0.076253 May 26 13:04:19.261364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 536/1097] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:19 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1236 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:04:19.658370 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-95402815-51d5-45a2-9e13-f5b6b0cf7e24 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:19.659051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-95402815-51d5-45a2-9e13-f5b6b0cf7e24 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:19.665921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95402815-51d5-45a2-9e13-f5b6b0cf7e24 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:19.667329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95402815-51d5-45a2-9e13-f5b6b0cf7e24 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:19.668187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95402815-51d5-45a2-9e13-f5b6b0cf7e24 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:19.668757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95402815-51d5-45a2-9e13-f5b6b0cf7e24 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:19.816338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-95402815-51d5-45a2-9e13-f5b6b0cf7e24 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:19.825236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-95402815-51d5-45a2-9e13-f5b6b0cf7e24 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.170671 May 26 13:04:19.825827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 562/1098] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:19 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:20.283812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8feac24f-3267-4675-ab00-b6d487550b75 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:20.284294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8feac24f-3267-4675-ab00-b6d487550b75 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:20.291556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8feac24f-3267-4675-ab00-b6d487550b75 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:20.292024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8feac24f-3267-4675-ab00-b6d487550b75 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:20.292797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8feac24f-3267-4675-ab00-b6d487550b75 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:20.293235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8feac24f-3267-4675-ab00-b6d487550b75 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:20.355701 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8feac24f-3267-4675-ab00-b6d487550b75 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:20.363364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8feac24f-3267-4675-ab00-b6d487550b75 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1240 microversion: 2.1 time: 0.083476 May 26 13:04:20.364030 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 537/1099] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:20 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:20.843604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-632fdfae-88e7-4c58-81ae-4aa60e0a783b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:20.844207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-632fdfae-88e7-4c58-81ae-4aa60e0a783b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:20.850871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-632fdfae-88e7-4c58-81ae-4aa60e0a783b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:20.851327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-632fdfae-88e7-4c58-81ae-4aa60e0a783b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:20.852101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-632fdfae-88e7-4c58-81ae-4aa60e0a783b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:20.852542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-632fdfae-88e7-4c58-81ae-4aa60e0a783b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:20.990484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-632fdfae-88e7-4c58-81ae-4aa60e0a783b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:20.999551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-632fdfae-88e7-4c58-81ae-4aa60e0a783b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.159795 May 26 13:04:21.000134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 563/1100] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:20 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:21.381177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c0f2ee81-e9f6-47a4-b0d8-83bf8d146254 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:21.381794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c0f2ee81-e9f6-47a4-b0d8-83bf8d146254 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:21.388429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0f2ee81-e9f6-47a4-b0d8-83bf8d146254 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:21.388886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0f2ee81-e9f6-47a4-b0d8-83bf8d146254 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:21.389662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0f2ee81-e9f6-47a4-b0d8-83bf8d146254 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:21.390110 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0f2ee81-e9f6-47a4-b0d8-83bf8d146254 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:21.453888 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0f2ee81-e9f6-47a4-b0d8-83bf8d146254 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:21.462557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c0f2ee81-e9f6-47a4-b0d8-83bf8d146254 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1240 microversion: 2.1 time: 0.085149 May 26 13:04:21.463246 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 538/1101] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:21 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:22.016813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9042252-b3c1-4bdf-afaf-cb30a58ba85d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:22.017413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9042252-b3c1-4bdf-afaf-cb30a58ba85d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:22.024066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9042252-b3c1-4bdf-afaf-cb30a58ba85d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:22.024531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9042252-b3c1-4bdf-afaf-cb30a58ba85d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:22.025826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9042252-b3c1-4bdf-afaf-cb30a58ba85d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:22.026277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9042252-b3c1-4bdf-afaf-cb30a58ba85d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:22.062271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:22.167503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9042252-b3c1-4bdf-afaf-cb30a58ba85d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:22.175251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9042252-b3c1-4bdf-afaf-cb30a58ba85d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.162344 May 26 13:04:22.175835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 564/1102] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:22 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:22.479963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-08258d5b-6d78-476a-9a22-f5cc2b9ae1e0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:22.481297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-08258d5b-6d78-476a-9a22-f5cc2b9ae1e0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:22.488777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08258d5b-6d78-476a-9a22-f5cc2b9ae1e0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:22.489655 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08258d5b-6d78-476a-9a22-f5cc2b9ae1e0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:22.490482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08258d5b-6d78-476a-9a22-f5cc2b9ae1e0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:22.490943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08258d5b-6d78-476a-9a22-f5cc2b9ae1e0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:22.560994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08258d5b-6d78-476a-9a22-f5cc2b9ae1e0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:22.569325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-08258d5b-6d78-476a-9a22-f5cc2b9ae1e0 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1306 microversion: 2.1 time: 0.093533 May 26 13:04:22.569963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 539/1103] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:22 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:23.196246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e48a3b10-0990-4538-b88f-dae4b87b7fc7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:23.197316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e48a3b10-0990-4538-b88f-dae4b87b7fc7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:23.207751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e48a3b10-0990-4538-b88f-dae4b87b7fc7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:23.208428 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e48a3b10-0990-4538-b88f-dae4b87b7fc7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:23.209446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e48a3b10-0990-4538-b88f-dae4b87b7fc7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:23.210208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e48a3b10-0990-4538-b88f-dae4b87b7fc7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:23.435541 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e48a3b10-0990-4538-b88f-dae4b87b7fc7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:23.443784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e48a3b10-0990-4538-b88f-dae4b87b7fc7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.253967 May 26 13:04:23.444304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 565/1104] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:23 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:23.644779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ce16d8b-31a7-4e45-b3b5-5d76046991c5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:23.645490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ce16d8b-31a7-4e45-b3b5-5d76046991c5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:23.651537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ce16d8b-31a7-4e45-b3b5-5d76046991c5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:23.651988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ce16d8b-31a7-4e45-b3b5-5d76046991c5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:23.652762 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ce16d8b-31a7-4e45-b3b5-5d76046991c5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:23.653204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ce16d8b-31a7-4e45-b3b5-5d76046991c5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:23.799482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9ce16d8b-31a7-4e45-b3b5-5d76046991c5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:23.810935 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ce16d8b-31a7-4e45-b3b5-5d76046991c5 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.226530 May 26 13:04:23.811526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 540/1105] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:23 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:24.202366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-4da1ad45-eb05-42bf-94a3-ac9a6f334311 req-f1eac33a-d227-4407-8e6f-65dd70e8a2cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b17a77-ad67-4dda-8c75-e381fe6ce4c4", "tag": "506800aa-d5da-4996-ab4b-c8b5d5e7dacb"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:24.206438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4da1ad45-eb05-42bf-94a3-ac9a6f334311 req-f1eac33a-d227-4407-8e6f-65dd70e8a2cd service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:24.206990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4da1ad45-eb05-42bf-94a3-ac9a6f334311 req-f1eac33a-d227-4407-8e6f-65dd70e8a2cd service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:24.211757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:24.232100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-4da1ad45-eb05-42bf-94a3-ac9a6f334311 req-f1eac33a-d227-4407-8e6f-65dd70e8a2cd service nova] Creating event network-changed:506800aa-d5da-4996-ab4b-c8b5d5e7dacb for instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 on hv-cinder-81514 May 26 13:04:24.234165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-4da1ad45-eb05-42bf-94a3-ac9a6f334311 req-f1eac33a-d227-4407-8e6f-65dd70e8a2cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043492 May 26 13:04:24.235070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 566/1106] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:04:24.461227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5d3334e-ce07-406f-b427-a190ba511a36 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:24.461765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d5d3334e-ce07-406f-b427-a190ba511a36 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:24.468819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5d3334e-ce07-406f-b427-a190ba511a36 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:24.469277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5d3334e-ce07-406f-b427-a190ba511a36 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:24.470060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5d3334e-ce07-406f-b427-a190ba511a36 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:24.470493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5d3334e-ce07-406f-b427-a190ba511a36 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:24.489664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:24.614306 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d5d3334e-ce07-406f-b427-a190ba511a36 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:24.622466 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d5d3334e-ce07-406f-b427-a190ba511a36 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.165099 May 26 13:04:24.623076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 541/1107] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:24 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:24.829900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-371ce61e-33a2-4e0b-9aef-dedfc8e18fbf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:24.830625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-371ce61e-33a2-4e0b-9aef-dedfc8e18fbf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:24.837289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371ce61e-33a2-4e0b-9aef-dedfc8e18fbf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:24.837874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371ce61e-33a2-4e0b-9aef-dedfc8e18fbf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:24.838647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371ce61e-33a2-4e0b-9aef-dedfc8e18fbf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:24.839086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371ce61e-33a2-4e0b-9aef-dedfc8e18fbf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:25.012446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-371ce61e-33a2-4e0b-9aef-dedfc8e18fbf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:25.020300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-371ce61e-33a2-4e0b-9aef-dedfc8e18fbf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.194925 May 26 13:04:25.020892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 567/1108] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:24 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:25.641256 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-96ea3d24-8441-4489-bea7-2d12c3156d6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:25.641819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-96ea3d24-8441-4489-bea7-2d12c3156d6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:25.649803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:25.652313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96ea3d24-8441-4489-bea7-2d12c3156d6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:25.652767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96ea3d24-8441-4489-bea7-2d12c3156d6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:25.653882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96ea3d24-8441-4489-bea7-2d12c3156d6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:25.654331 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96ea3d24-8441-4489-bea7-2d12c3156d6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:25.802335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-96ea3d24-8441-4489-bea7-2d12c3156d6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:25.812477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-96ea3d24-8441-4489-bea7-2d12c3156d6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.176091 May 26 13:04:25.813404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 542/1109] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:25 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:26.041219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-738f2374-d911-47b6-aa42-06973213cbc2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:26.041827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-738f2374-d911-47b6-aa42-06973213cbc2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:26.048876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-738f2374-d911-47b6-aa42-06973213cbc2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:26.049337 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-738f2374-d911-47b6-aa42-06973213cbc2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:26.050138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-738f2374-d911-47b6-aa42-06973213cbc2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:26.050613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-738f2374-d911-47b6-aa42-06973213cbc2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:26.318481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-738f2374-d911-47b6-aa42-06973213cbc2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:26.327404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-738f2374-d911-47b6-aa42-06973213cbc2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.290200 May 26 13:04:26.327991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 568/1110] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:26 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:26.829502 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-735a8675-cab2-4396-b6c2-f0040e46caa8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:26.830096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-735a8675-cab2-4396-b6c2-f0040e46caa8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:26.836975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-735a8675-cab2-4396-b6c2-f0040e46caa8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:26.837433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-735a8675-cab2-4396-b6c2-f0040e46caa8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:26.839330 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-735a8675-cab2-4396-b6c2-f0040e46caa8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:26.839782 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-735a8675-cab2-4396-b6c2-f0040e46caa8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:26.982207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-735a8675-cab2-4396-b6c2-f0040e46caa8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:26.990819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-735a8675-cab2-4396-b6c2-f0040e46caa8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.165130 May 26 13:04:26.991390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 543/1111] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:26 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:27.344943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-58923aed-8aa8-4fbe-9bc2-ea76213a5c27 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:27.345595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-58923aed-8aa8-4fbe-9bc2-ea76213a5c27 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:27.348061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:27.353015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58923aed-8aa8-4fbe-9bc2-ea76213a5c27 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:27.357590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58923aed-8aa8-4fbe-9bc2-ea76213a5c27 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:27.357590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58923aed-8aa8-4fbe-9bc2-ea76213a5c27 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:27.357590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58923aed-8aa8-4fbe-9bc2-ea76213a5c27 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:27.494809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-58923aed-8aa8-4fbe-9bc2-ea76213a5c27 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:27.505589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-58923aed-8aa8-4fbe-9bc2-ea76213a5c27 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.164015 May 26 13:04:27.506579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 569/1112] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:27 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:28.008578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-777ed891-41e6-4491-8c5c-c92c059a13c5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:28.009168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-777ed891-41e6-4491-8c5c-c92c059a13c5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:28.018371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-777ed891-41e6-4491-8c5c-c92c059a13c5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:28.019108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-777ed891-41e6-4491-8c5c-c92c059a13c5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:28.019901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-777ed891-41e6-4491-8c5c-c92c059a13c5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:28.020413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-777ed891-41e6-4491-8c5c-c92c059a13c5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:28.158133 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-777ed891-41e6-4491-8c5c-c92c059a13c5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:28.167462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-777ed891-41e6-4491-8c5c-c92c059a13c5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.162621 May 26 13:04:28.168377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 544/1113] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:28 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:28.526688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-26eae551-fcbb-4fd1-b2e0-754c7b70d469 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:28.527234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-26eae551-fcbb-4fd1-b2e0-754c7b70d469 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:28.533272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26eae551-fcbb-4fd1-b2e0-754c7b70d469 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:28.538044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26eae551-fcbb-4fd1-b2e0-754c7b70d469 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:28.538044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26eae551-fcbb-4fd1-b2e0-754c7b70d469 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:28.538044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26eae551-fcbb-4fd1-b2e0-754c7b70d469 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:28.663112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-26eae551-fcbb-4fd1-b2e0-754c7b70d469 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:28.671198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-26eae551-fcbb-4fd1-b2e0-754c7b70d469 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.149331 May 26 13:04:28.671779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 570/1114] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:28 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:29.185031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a787c7d2-c9d6-4b22-ae7b-6f5c2060b40b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:29.185742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a787c7d2-c9d6-4b22-ae7b-6f5c2060b40b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:29.192230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a787c7d2-c9d6-4b22-ae7b-6f5c2060b40b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:29.192686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a787c7d2-c9d6-4b22-ae7b-6f5c2060b40b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:29.193457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a787c7d2-c9d6-4b22-ae7b-6f5c2060b40b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:29.193899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a787c7d2-c9d6-4b22-ae7b-6f5c2060b40b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:29.255515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=16 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:29.333125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a787c7d2-c9d6-4b22-ae7b-6f5c2060b40b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:29.341044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a787c7d2-c9d6-4b22-ae7b-6f5c2060b40b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.160576 May 26 13:04:29.341616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 545/1115] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:29 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:29.688590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e02a68d5-2afd-4b38-891e-6393d04acd56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:29.689271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e02a68d5-2afd-4b38-891e-6393d04acd56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:29.695746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e02a68d5-2afd-4b38-891e-6393d04acd56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:29.696194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e02a68d5-2afd-4b38-891e-6393d04acd56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:29.696953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e02a68d5-2afd-4b38-891e-6393d04acd56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:29.697389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e02a68d5-2afd-4b38-891e-6393d04acd56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:29.830467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e02a68d5-2afd-4b38-891e-6393d04acd56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:29.837842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e02a68d5-2afd-4b38-891e-6393d04acd56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.153159 May 26 13:04:29.838442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 571/1116] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:29 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:30.191876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2f7d764e-f659-459f-b0fb-b6b64875842c req-4fd4d9bc-6b96-4ab7-894c-f718d4e37a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d4069d-fe62-4f1e-b4ad-ed907dbf2b99", "name": "network-vif-plugged", "status": "completed", "tag": "bd3badd8-5652-406f-8c25-159b3d8554a1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:30.200603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2f7d764e-f659-459f-b0fb-b6b64875842c req-4fd4d9bc-6b96-4ab7-894c-f718d4e37a82 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:30.201085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2f7d764e-f659-459f-b0fb-b6b64875842c req-4fd4d9bc-6b96-4ab7-894c-f718d4e37a82 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:30.212434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2f7d764e-f659-459f-b0fb-b6b64875842c req-4fd4d9bc-6b96-4ab7-894c-f718d4e37a82 service nova] Creating event network-vif-plugged:bd3badd8-5652-406f-8c25-159b3d8554a1 for instance 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 on hv-cinder-81514 May 26 13:04:30.218250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2f7d764e-f659-459f-b0fb-b6b64875842c req-4fd4d9bc-6b96-4ab7-894c-f718d4e37a82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030041 May 26 13:04:30.218898 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 546/1117] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:04:30.359660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a383b93-8ee2-4e0c-862c-35aa4a786d2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:30.360309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a383b93-8ee2-4e0c-862c-35aa4a786d2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:30.366225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a383b93-8ee2-4e0c-862c-35aa4a786d2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:30.366711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a383b93-8ee2-4e0c-862c-35aa4a786d2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:30.367514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a383b93-8ee2-4e0c-862c-35aa4a786d2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:30.368006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a383b93-8ee2-4e0c-862c-35aa4a786d2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:30.503309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a383b93-8ee2-4e0c-862c-35aa4a786d2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:30.508643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a383b93-8ee2-4e0c-862c-35aa4a786d2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.152843 May 26 13:04:30.509201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 572/1118] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:30 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:30.855253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e67a3d76-baa8-4c6f-98d6-a27891624264 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:30.855859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e67a3d76-baa8-4c6f-98d6-a27891624264 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:30.862086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e67a3d76-baa8-4c6f-98d6-a27891624264 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:30.862602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e67a3d76-baa8-4c6f-98d6-a27891624264 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:30.863390 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e67a3d76-baa8-4c6f-98d6-a27891624264 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:30.863830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e67a3d76-baa8-4c6f-98d6-a27891624264 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:30.996964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e67a3d76-baa8-4c6f-98d6-a27891624264 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:31.004734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e67a3d76-baa8-4c6f-98d6-a27891624264 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.154217 May 26 13:04:31.005314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 547/1119] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:30 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:31.526336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e65e1558-e198-4961-9927-d78619793384 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:31.527596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e65e1558-e198-4961-9927-d78619793384 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:31.534235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e65e1558-e198-4961-9927-d78619793384 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:31.534717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e65e1558-e198-4961-9927-d78619793384 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:31.535488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e65e1558-e198-4961-9927-d78619793384 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:31.535927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e65e1558-e198-4961-9927-d78619793384 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:31.666470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e65e1558-e198-4961-9927-d78619793384 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:31.674782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e65e1558-e198-4961-9927-d78619793384 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1265 microversion: 2.1 time: 0.152276 May 26 13:04:31.675359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 573/1120] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:31 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:32.022577 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d38448b3-62f8-4929-87bd-8197b1877005 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:32.023187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d38448b3-62f8-4929-87bd-8197b1877005 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:32.034132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d38448b3-62f8-4929-87bd-8197b1877005 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:32.034618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d38448b3-62f8-4929-87bd-8197b1877005 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:32.035401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d38448b3-62f8-4929-87bd-8197b1877005 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:32.035839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d38448b3-62f8-4929-87bd-8197b1877005 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:32.172411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d38448b3-62f8-4929-87bd-8197b1877005 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:32.179958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d38448b3-62f8-4929-87bd-8197b1877005 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.161210 May 26 13:04:32.180743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 548/1121] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:32 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:32.247318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c1975a87-c312-4a1d-ad39-efb0be18afc6 req-0a573fc0-e2bc-4d54-a1a5-64c2b6dd9cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b17a77-ad67-4dda-8c75-e381fe6ce4c4", "name": "network-vif-plugged", "status": "completed", "tag": "506800aa-d5da-4996-ab4b-c8b5d5e7dacb"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:32.255344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c1975a87-c312-4a1d-ad39-efb0be18afc6 req-0a573fc0-e2bc-4d54-a1a5-64c2b6dd9cc1 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:32.258431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c1975a87-c312-4a1d-ad39-efb0be18afc6 req-0a573fc0-e2bc-4d54-a1a5-64c2b6dd9cc1 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:32.267739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c1975a87-c312-4a1d-ad39-efb0be18afc6 req-0a573fc0-e2bc-4d54-a1a5-64c2b6dd9cc1 service nova] Creating event network-vif-plugged:506800aa-d5da-4996-ab4b-c8b5d5e7dacb for instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 on hv-cinder-81514 May 26 13:04:32.272825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-c1975a87-c312-4a1d-ad39-efb0be18afc6 req-0a573fc0-e2bc-4d54-a1a5-64c2b6dd9cc1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030357 May 26 13:04:32.273409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 574/1122] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:04:32.691960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-71baeb1b-9b4b-421d-9a04-0e51ccc1a153 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:32.692574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-71baeb1b-9b4b-421d-9a04-0e51ccc1a153 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:32.698898 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71baeb1b-9b4b-421d-9a04-0e51ccc1a153 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:32.699378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71baeb1b-9b4b-421d-9a04-0e51ccc1a153 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:32.700161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71baeb1b-9b4b-421d-9a04-0e51ccc1a153 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:32.700610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71baeb1b-9b4b-421d-9a04-0e51ccc1a153 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:32.836294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-71baeb1b-9b4b-421d-9a04-0e51ccc1a153 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:32.844259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-71baeb1b-9b4b-421d-9a04-0e51ccc1a153 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1452 microversion: 2.1 time: 0.156204 May 26 13:04:32.844833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 549/1123] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:32 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:32.861473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b1df17c-85f5-41c6-9237-cdd89b7c9c20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:32.862168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b1df17c-85f5-41c6-9237-cdd89b7c9c20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:32.868406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b1df17c-85f5-41c6-9237-cdd89b7c9c20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:32.868851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b1df17c-85f5-41c6-9237-cdd89b7c9c20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:32.869891 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b1df17c-85f5-41c6-9237-cdd89b7c9c20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:32.871122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b1df17c-85f5-41c6-9237-cdd89b7c9c20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:33.006296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7b1df17c-85f5-41c6-9237-cdd89b7c9c20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:33.013816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7b1df17c-85f5-41c6-9237-cdd89b7c9c20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1452 microversion: 2.1 time: 0.156896 May 26 13:04:33.014363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 575/1124] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:32 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:04:33.197418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23b25325-af69-4b22-af8c-c1e06e971765 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:33.198053 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23b25325-af69-4b22-af8c-c1e06e971765 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:33.202789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:33.207231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23b25325-af69-4b22-af8c-c1e06e971765 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:33.207686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23b25325-af69-4b22-af8c-c1e06e971765 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:33.208457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23b25325-af69-4b22-af8c-c1e06e971765 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:33.208975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23b25325-af69-4b22-af8c-c1e06e971765 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:33.426626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23b25325-af69-4b22-af8c-c1e06e971765 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:33.434202 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23b25325-af69-4b22-af8c-c1e06e971765 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1362 microversion: 2.1 time: 0.240686 May 26 13:04:33.434798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 550/1125] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:33 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:34.451196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bfa5c393-b105-4dac-a636-7ee055abfbe2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:34.451825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bfa5c393-b105-4dac-a636-7ee055abfbe2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:34.454315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:34.459099 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfa5c393-b105-4dac-a636-7ee055abfbe2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:34.459554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfa5c393-b105-4dac-a636-7ee055abfbe2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:34.460400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfa5c393-b105-4dac-a636-7ee055abfbe2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:34.460847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfa5c393-b105-4dac-a636-7ee055abfbe2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:34.600679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bfa5c393-b105-4dac-a636-7ee055abfbe2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:04:34.608991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bfa5c393-b105-4dac-a636-7ee055abfbe2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1548 microversion: 2.1 time: 0.161713 May 26 13:04:34.609645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 576/1126] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:04:34 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:04:34.625948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d68bb8cb-4612-4340-95b3-6c412553612e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:04:34.626493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d68bb8cb-4612-4340-95b3-6c412553612e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:04:34.633844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d68bb8cb-4612-4340-95b3-6c412553612e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:34.633844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d68bb8cb-4612-4340-95b3-6c412553612e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:34.634444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d68bb8cb-4612-4340-95b3-6c412553612e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:34.634854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d68bb8cb-4612-4340-95b3-6c412553612e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:34.751454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d68bb8cb-4612-4340-95b3-6c412553612e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129389 May 26 13:04:34.752230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 551/1127] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 26 13:04:34 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:04:35.169776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-204b7b3c-a36e-4c79-b500-f5f9645fe19f req-1fe2838a-c9d2-4deb-9056-2c2defb0ec7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d4069d-fe62-4f1e-b4ad-ed907dbf2b99", "tag": "bd3badd8-5652-406f-8c25-159b3d8554a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:35.179070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-204b7b3c-a36e-4c79-b500-f5f9645fe19f req-1fe2838a-c9d2-4deb-9056-2c2defb0ec7a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:35.181399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-204b7b3c-a36e-4c79-b500-f5f9645fe19f req-1fe2838a-c9d2-4deb-9056-2c2defb0ec7a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:35.191817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-204b7b3c-a36e-4c79-b500-f5f9645fe19f req-1fe2838a-c9d2-4deb-9056-2c2defb0ec7a service nova] Creating event network-changed:bd3badd8-5652-406f-8c25-159b3d8554a1 for instance 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 on hv-cinder-81514 May 26 13:04:35.196691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-204b7b3c-a36e-4c79-b500-f5f9645fe19f req-1fe2838a-c9d2-4deb-9056-2c2defb0ec7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030769 May 26 13:04:35.197642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 577/1128] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:04:36.145238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-ff3231be-b9f5-45d9-aba8-c9e3284b68d3 req-35fd5c70-eae4-4189-bfb6-162dfab4b8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b17a77-ad67-4dda-8c75-e381fe6ce4c4", "tag": "506800aa-d5da-4996-ab4b-c8b5d5e7dacb"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:04:36.154484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-ff3231be-b9f5-45d9-aba8-c9e3284b68d3 req-35fd5c70-eae4-4189-bfb6-162dfab4b8ce service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:04:36.155755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-ff3231be-b9f5-45d9-aba8-c9e3284b68d3 req-35fd5c70-eae4-4189-bfb6-162dfab4b8ce service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:04:36.169274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-ff3231be-b9f5-45d9-aba8-c9e3284b68d3 req-35fd5c70-eae4-4189-bfb6-162dfab4b8ce service nova] Creating event network-changed:506800aa-d5da-4996-ab4b-c8b5d5e7dacb for instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 on hv-cinder-81514 May 26 13:04:36.174671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-ff3231be-b9f5-45d9-aba8-c9e3284b68d3 req-35fd5c70-eae4-4189-bfb6-162dfab4b8ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033630 May 26 13:04:36.175674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 552/1129] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:05:51.205271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=58 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:05:51.210076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e667d04-b0f6-4d24-a6e4-62719882c159 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:05:51.210687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e667d04-b0f6-4d24-a6e4-62719882c159 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:05:51.217280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e667d04-b0f6-4d24-a6e4-62719882c159 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:05:51.221862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e667d04-b0f6-4d24-a6e4-62719882c159 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:05:51.221862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e667d04-b0f6-4d24-a6e4-62719882c159 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:05:51.221862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e667d04-b0f6-4d24-a6e4-62719882c159 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:05:51.242797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e667d04-b0f6-4d24-a6e4-62719882c159 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/ips" status: 200 len: 145 microversion: 2.1 time: 0.040178 May 26 13:05:51.243367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 578/1130] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 26 13:05:51 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:05:52.834948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:05:52.835838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=58 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:05:52.840137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7bd31b4e-5e16-461d-80a4-3e13190a1035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4465c958-c304-4333-945c-51e520f03872"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:05:52.841276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7bd31b4e-5e16-461d-80a4-3e13190a1035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:05:52.847423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bd31b4e-5e16-461d-80a4-3e13190a1035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:05:52.847874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bd31b4e-5e16-461d-80a4-3e13190a1035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:05:52.848637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bd31b4e-5e16-461d-80a4-3e13190a1035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:05:52.849073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bd31b4e-5e16-461d-80a4-3e13190a1035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:05:53.599932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7bd31b4e-5e16-461d-80a4-3e13190a1035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766679 May 26 13:05:53.601793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 553/1131] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 13:05:52 2022] POST /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:02.167204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b43f23e3-ef48-4b2f-8919-365625432e56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:02.168130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b43f23e3-ef48-4b2f-8919-365625432e56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:02.170505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:02.175450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b43f23e3-ef48-4b2f-8919-365625432e56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:02.175924 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b43f23e3-ef48-4b2f-8919-365625432e56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:02.176675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b43f23e3-ef48-4b2f-8919-365625432e56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:02.177110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b43f23e3-ef48-4b2f-8919-365625432e56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:02.205702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b43f23e3-ef48-4b2f-8919-365625432e56 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042330 May 26 13:06:02.206245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 579/1132] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 13:06:02 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:02.217744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e806618e-4da0-41a2-b7d6-3b28789046fc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:02.218326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e806618e-4da0-41a2-b7d6-3b28789046fc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:02.225500 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e806618e-4da0-41a2-b7d6-3b28789046fc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:02.225956 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e806618e-4da0-41a2-b7d6-3b28789046fc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:02.226763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e806618e-4da0-41a2-b7d6-3b28789046fc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:02.227206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e806618e-4da0-41a2-b7d6-3b28789046fc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:02.255553 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e806618e-4da0-41a2-b7d6-3b28789046fc tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/4465c958-c304-4333-945c-51e520f03872" status: 200 len: 194 microversion: 2.1 time: 0.042720 May 26 13:06:02.256139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 554/1133] 10.222.0.60 () {58 vars in 1412 bytes} [Thu May 26 13:06:02 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/4465c958-c304-4333-945c-51e520f03872 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:03.859455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-63714cbf-25c5-4906-81b7-724627c7dafb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85efb372-ab81-41bc-abb1-df5cf122309f"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:06:03.860533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-63714cbf-25c5-4906-81b7-724627c7dafb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:03.868021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63714cbf-25c5-4906-81b7-724627c7dafb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:03.868478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63714cbf-25c5-4906-81b7-724627c7dafb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:03.869256 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63714cbf-25c5-4906-81b7-724627c7dafb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:03.869698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63714cbf-25c5-4906-81b7-724627c7dafb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:04.433286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-63714cbf-25c5-4906-81b7-724627c7dafb tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "POST /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577916 May 26 13:06:04.433915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 580/1134] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 13:06:03 2022] POST /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments => generated 194 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:12.980088 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3096e6a-a0e7-4cab-8bc2-f86b972f72f1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:12.981068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3096e6a-a0e7-4cab-8bc2-f86b972f72f1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:12.983561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:12.984217 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:12.988886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3096e6a-a0e7-4cab-8bc2-f86b972f72f1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:12.989336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3096e6a-a0e7-4cab-8bc2-f86b972f72f1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:12.990094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3096e6a-a0e7-4cab-8bc2-f86b972f72f1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:12.990545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3096e6a-a0e7-4cab-8bc2-f86b972f72f1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:13.019735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3096e6a-a0e7-4cab-8bc2-f86b972f72f1 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043567 May 26 13:06:13.020279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 555/1135] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 13:06:12 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:13.161949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bb70f48-352f-4c04-ba55-c328ce608e7e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:13.162479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bb70f48-352f-4c04-ba55-c328ce608e7e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:13.168993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bb70f48-352f-4c04-ba55-c328ce608e7e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:13.169532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bb70f48-352f-4c04-ba55-c328ce608e7e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:13.170291 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bb70f48-352f-4c04-ba55-c328ce608e7e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:13.170756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bb70f48-352f-4c04-ba55-c328ce608e7e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:13.199828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bb70f48-352f-4c04-ba55-c328ce608e7e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/4465c958-c304-4333-945c-51e520f03872" status: 200 len: 194 microversion: 2.1 time: 0.042925 May 26 13:06:13.200400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 581/1136] 10.222.0.60 () {58 vars in 1412 bytes} [Thu May 26 13:06:13 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/4465c958-c304-4333-945c-51e520f03872 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:13.211104 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5007a52-9077-46a2-9ef5-3fade1cbe04e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:13.211329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5007a52-9077-46a2-9ef5-3fade1cbe04e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:13.218130 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5007a52-9077-46a2-9ef5-3fade1cbe04e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:13.218617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5007a52-9077-46a2-9ef5-3fade1cbe04e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:13.219388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5007a52-9077-46a2-9ef5-3fade1cbe04e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:13.219826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5007a52-9077-46a2-9ef5-3fade1cbe04e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:13.302131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-c5007a52-9077-46a2-9ef5-3fade1cbe04e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lazy-loading 'services' on Instance uuid b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:06:13.571928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5007a52-9077-46a2-9ef5-3fade1cbe04e tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/4465c958-c304-4333-945c-51e520f03872" status: 202 len: 0 microversion: 2.1 time: 0.365772 May 26 13:06:13.572697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 556/1137] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 13:06:13 2022] DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/4465c958-c304-4333-945c-51e520f03872 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:06:15.739964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cccbffc5-3bcc-46df-bfcb-c4ed28292891 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:15.740495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cccbffc5-3bcc-46df-bfcb-c4ed28292891 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:15.747288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cccbffc5-3bcc-46df-bfcb-c4ed28292891 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:15.747733 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cccbffc5-3bcc-46df-bfcb-c4ed28292891 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:15.748492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cccbffc5-3bcc-46df-bfcb-c4ed28292891 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:15.748927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cccbffc5-3bcc-46df-bfcb-c4ed28292891 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:15.778456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cccbffc5-3bcc-46df-bfcb-c4ed28292891 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/85efb372-ab81-41bc-abb1-df5cf122309f" status: 200 len: 194 microversion: 2.1 time: 0.042453 May 26 13:06:15.779073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 582/1138] 10.222.0.60 () {58 vars in 1412 bytes} [Thu May 26 13:06:15 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/85efb372-ab81-41bc-abb1-df5cf122309f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:15.789861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b2a9744e-c1e2-4d8e-9816-afd6d83b5fc4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:15.790451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b2a9744e-c1e2-4d8e-9816-afd6d83b5fc4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:15.797127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2a9744e-c1e2-4d8e-9816-afd6d83b5fc4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:15.797580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2a9744e-c1e2-4d8e-9816-afd6d83b5fc4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:15.798350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2a9744e-c1e2-4d8e-9816-afd6d83b5fc4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:15.798824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2a9744e-c1e2-4d8e-9816-afd6d83b5fc4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:15.881656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-b2a9744e-c1e2-4d8e-9816-afd6d83b5fc4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lazy-loading 'services' on Instance uuid b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:06:16.094864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b2a9744e-c1e2-4d8e-9816-afd6d83b5fc4 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/85efb372-ab81-41bc-abb1-df5cf122309f" status: 202 len: 0 microversion: 2.1 time: 0.309412 May 26 13:06:16.095834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 557/1139] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 13:06:15 2022] DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments/85efb372-ab81-41bc-abb1-df5cf122309f => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:06:17.267515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1879de37-cc54-4f65-ab49-c2799f4f7dca tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:17.268800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1879de37-cc54-4f65-ab49-c2799f4f7dca tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:17.276341 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1879de37-cc54-4f65-ab49-c2799f4f7dca tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:17.276813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1879de37-cc54-4f65-ab49-c2799f4f7dca tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:17.277644 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1879de37-cc54-4f65-ab49-c2799f4f7dca tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:17.278111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1879de37-cc54-4f65-ab49-c2799f4f7dca tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:17.308192 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1879de37-cc54-4f65-ab49-c2799f4f7dca tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 May 26 13:06:17.308758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 583/1140] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 13:06:17 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:18.320874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-830edfd3-f978-49b2-9768-e4e306e06414 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:18.322290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-830edfd3-f978-49b2-9768-e4e306e06414 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:18.328766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-830edfd3-f978-49b2-9768-e4e306e06414 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:18.329222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-830edfd3-f978-49b2-9768-e4e306e06414 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:18.330044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-830edfd3-f978-49b2-9768-e4e306e06414 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:18.330482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-830edfd3-f978-49b2-9768-e4e306e06414 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:18.361057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-830edfd3-f978-49b2-9768-e4e306e06414 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044989 May 26 13:06:18.361634 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 558/1141] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 13:06:18 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:06:18.474682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9be4306-aa49-49f5-879d-9769c1b74da6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:18.475606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9be4306-aa49-49f5-879d-9769c1b74da6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:18.482652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9be4306-aa49-49f5-879d-9769c1b74da6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:18.483094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9be4306-aa49-49f5-879d-9769c1b74da6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:18.483940 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9be4306-aa49-49f5-879d-9769c1b74da6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:18.484371 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9be4306-aa49-49f5-879d-9769c1b74da6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:18.512914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9be4306-aa49-49f5-879d-9769c1b74da6 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042217 May 26 13:06:18.513495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 584/1142] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 26 13:06:18 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:06:18.572265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff22c96b-2b9b-4c45-a9f8-1609012840a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:18.572769 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff22c96b-2b9b-4c45-a9f8-1609012840a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:18.578738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff22c96b-2b9b-4c45-a9f8-1609012840a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:18.579202 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff22c96b-2b9b-4c45-a9f8-1609012840a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:18.579971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff22c96b-2b9b-4c45-a9f8-1609012840a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:18.580410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff22c96b-2b9b-4c45-a9f8-1609012840a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:18.609641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff22c96b-2b9b-4c45-a9f8-1609012840a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:06:18.902324 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff22c96b-2b9b-4c45-a9f8-1609012840a2 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 204 len: 0 microversion: 2.1 time: 0.333941 May 26 13:06:18.902954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 559/1143] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:06:18 2022] DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:06:18.916343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1dcb9e63-695d-4769-9663-3fb2a9ae357d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:18.916968 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1dcb9e63-695d-4769-9663-3fb2a9ae357d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:18.923211 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dcb9e63-695d-4769-9663-3fb2a9ae357d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:18.923669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dcb9e63-695d-4769-9663-3fb2a9ae357d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:18.924440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dcb9e63-695d-4769-9663-3fb2a9ae357d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:18.924884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dcb9e63-695d-4769-9663-3fb2a9ae357d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:19.059260 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dcb9e63-695d-4769-9663-3fb2a9ae357d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:19.066752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1dcb9e63-695d-4769-9663-3fb2a9ae357d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1672 microversion: 2.1 time: 0.154321 May 26 13:06:19.067318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 585/1144] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:18 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:20.085098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-144debd8-5d7e-4bad-9321-c7df78c2364d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:20.085797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-144debd8-5d7e-4bad-9321-c7df78c2364d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:20.093121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-144debd8-5d7e-4bad-9321-c7df78c2364d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:20.093574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-144debd8-5d7e-4bad-9321-c7df78c2364d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:20.094340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-144debd8-5d7e-4bad-9321-c7df78c2364d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:20.094813 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-144debd8-5d7e-4bad-9321-c7df78c2364d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:20.224307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-144debd8-5d7e-4bad-9321-c7df78c2364d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:20.232835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-144debd8-5d7e-4bad-9321-c7df78c2364d tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1672 microversion: 2.1 time: 0.151987 May 26 13:06:20.233403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 560/1145] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:20 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:21.250634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f1349796-fe00-406f-8b85-f60d0acd2aae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:21.251291 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f1349796-fe00-406f-8b85-f60d0acd2aae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:21.257711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1349796-fe00-406f-8b85-f60d0acd2aae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:21.258173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1349796-fe00-406f-8b85-f60d0acd2aae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:21.259679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1349796-fe00-406f-8b85-f60d0acd2aae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:21.260122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1349796-fe00-406f-8b85-f60d0acd2aae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:21.464072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f1349796-fe00-406f-8b85-f60d0acd2aae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:21.472638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f1349796-fe00-406f-8b85-f60d0acd2aae tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1672 microversion: 2.1 time: 0.225892 May 26 13:06:21.473414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 586/1146] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:21 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1672 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:22.210714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-e9c37e23-5248-4f27-8495-7b0d16cfd48f req-82e91a36-d0cf-4ae9-af97-b2e7475dfef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b17a77-ad67-4dda-8c75-e381fe6ce4c4", "name": "network-vif-deleted", "tag": "506800aa-d5da-4996-ab4b-c8b5d5e7dacb"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:06:22.219399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-e9c37e23-5248-4f27-8495-7b0d16cfd48f req-82e91a36-d0cf-4ae9-af97-b2e7475dfef7 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:22.219792 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-e9c37e23-5248-4f27-8495-7b0d16cfd48f req-82e91a36-d0cf-4ae9-af97-b2e7475dfef7 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:22.231380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-e9c37e23-5248-4f27-8495-7b0d16cfd48f req-82e91a36-d0cf-4ae9-af97-b2e7475dfef7 service nova] Creating event network-vif-deleted:506800aa-d5da-4996-ab4b-c8b5d5e7dacb for instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 on hv-cinder-81514 May 26 13:06:22.236919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-e9c37e23-5248-4f27-8495-7b0d16cfd48f req-82e91a36-d0cf-4ae9-af97-b2e7475dfef7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029921 May 26 13:06:22.237749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 561/1147] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:22.491586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:22.494309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:22.500277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:22.500740 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:22.501513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:22.501951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:22.534362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:22.534846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:22.535354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lazy-loading 'fault' on Instance uuid b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:06:22.582064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563aa380be524bc7970d486ce9ae82c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb152674fde4beebd5a106495b1ab2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:22.589711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1af5cf37-483f-44f0-92b1-f1d41154687c tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 200 len: 1326 microversion: 2.1 time: 0.102262 May 26 13:06:22.590290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 587/1148] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:22 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:23.608107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:23.608804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:23.615624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:23.616080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:23.616838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:23.617272 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:23.630359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] HTTP exception thrown: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Request method failure captured: May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 HTTP/1.1 May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3mrBCuMbUmGEaNCFWwbD98iS17kNT3A53idf9LjJDiNh-vJSPU4zelMQnyyCsw60mBzqwkNJco3fAc-7Mo9KsT64A9aEtM-m_fE4xgWnwBEnnHJV6tYnXQrl9n16C9Clj3BD9OjSqGP2PN3UMLmfsJbgZJDD8heJ7RwSxrUE3v1Kag May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 13:06:23.631974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 563aa380be524bc7970d486ce9ae82c7 May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:23.633734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': 'b0b17a77-ad67-4dda-8c75-e381fe6ce4c4'} May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:06:23.635325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:23.636942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:23.638395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Returning 404 to user: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:06:23.638395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2330826-f1b3-4f2e-ae39-5d138c5f51bf tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 404 len: 111 microversion: 2.1 time: 0.030150 May 26 13:06:23.638395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 562/1149] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:23 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:06:23.642399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f18e82e-6a52-4094-9b7f-875388fdd035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '.version_select at 0x7f498c22b0d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:23.719241 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f18e82e-6a52-4094-9b7f-875388fdd035 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-878141295" status: 202 len: 0 microversion: 2.1 time: 0.080617 May 26 13:06:23.719745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 588/1150] 10.222.0.60 () {58 vars in 1217 bytes} [Thu May 26 13:06:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-878141295 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:06:31.333778 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:31.334318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:31.342017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:31.343712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:31.343712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:31.343925 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:31.358878 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] HTTP exception thrown: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Request method failure captured: May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 HTTP/1.1 May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3mrBCuMbUmGEaNCFWwbD98iS17kNT3A53idf9LjJDiNh-vJSPU4zelMQnyyCsw60mBzqwkNJco3fAc-7Mo9KsT64A9aEtM-m_fE4xgWnwBEnnHJV6tYnXQrl9n16C9Clj3BD9OjSqGP2PN3UMLmfsJbgZJDD8heJ7RwSxrUE3v1Kag May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 13:06:31.360462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 563aa380be524bc7970d486ce9ae82c7 May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.362070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': 'b0b17a77-ad67-4dda-8c75-e381fe6ce4c4'} May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:06:31.362907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.364183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:06:31.365549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Returning 404 to user: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:06:31.365549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a40fd7de-ffbe-4a92-8e6b-992bf0990fb9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 404 len: 111 microversion: 2.1 time: 0.032173 May 26 13:06:31.365549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 563/1151] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:06:31 2022] DELETE /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:06:31.371313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:31.372361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: b0b17a77-ad67-4dda-8c75-e381fe6ce4c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:31.378704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:31.379222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:31.379988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:31.380424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:31.395491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] HTTP exception thrown: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Request method failure captured: May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 HTTP/1.1 May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3mrBCuMbUmGEaNCFWwbD98iS17kNT3A53idf9LjJDiNh-vJSPU4zelMQnyyCsw60mBzqwkNJco3fAc-7Mo9KsT64A9aEtM-m_fE4xgWnwBEnnHJV6tYnXQrl9n16C9Clj3BD9OjSqGP2PN3UMLmfsJbgZJDD8heJ7RwSxrUE3v1Kag May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 13:06:31.397427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 563aa380be524bc7970d486ce9ae82c7 May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.399146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': 'b0b17a77-ad67-4dda-8c75-e381fe6ce4c4'} May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:06:31.400013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. May 26 13:06:31.401535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:31.402722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Returning 404 to user: Instance b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:06:31.402722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d4c5a87-423d-4d61-b44c-cc1b0f0cdec9 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4" status: 404 len: 111 microversion: 2.1 time: 0.032188 May 26 13:06:31.402722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 589/1152] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:31 2022] GET /compute/v2.1/servers/b0b17a77-ad67-4dda-8c75-e381fe6ce4c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:06:36.767325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1543833230", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-193225139", "security_groups": [{"name": "tempest-secgroup-smoke-2017732673"}], "block_device_mapping_v2": [{"uuid": "334ac2cd-fd6b-4961-91e5-2eab6e803805", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d5d8628a-f8b7-48d9-9cb6-83fd3ac6436c"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:06:36.854015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:36.854606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:36.857103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:36.861822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:36.862273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:36.863083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:36.863525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:36.869539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:36.878425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] HTTP exception thrown: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Request method failure captured: May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 HTTP/1.1 May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3mrBCuMbUmGEaNCFWwbD98iS17kNT3A53idf9LjJDiNh-vJSPU4zelMQnyyCsw60mBzqwkNJco3fAc-7Mo9KsT64A9aEtM-m_fE4xgWnwBEnnHJV6tYnXQrl9n16C9Clj3BD9OjSqGP2PN3UMLmfsJbgZJDD8heJ7RwSxrUE3v1Kag May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 13:06:36.879987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 563aa380be524bc7970d486ce9ae82c7 May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.881417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '53635b2e-ae71-4639-b46e-f532ce5708a5'} May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:06:36.882208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.883977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.885884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Returning 404 to user: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:06:36.885884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1818e579-528b-4a08-8680-0e7ae4b53635 tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 404 len: 111 microversion: 2.1 time: 0.031319 May 26 13:06:36.885884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 590/1153] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:06:36 2022] DELETE /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 13:06:36.886230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] validate_networks() for [('d5d8628a-f8b7-48d9-9cb6-83fd3ac6436c', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:06:36.893734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:36.894345 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] [instance: 53635b2e-ae71-4639-b46e-f532ce5708a5] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:36.902275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:36.902751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:36.904567 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:36.904567 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:36.917710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] HTTP exception thrown: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Request method failure captured: May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 HTTP/1.1 May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3mrBCuMbUmGEaNCFWwbD98iS17kNT3A53idf9LjJDiNh-vJSPU4zelMQnyyCsw60mBzqwkNJco3fAc-7Mo9KsT64A9aEtM-m_fE4xgWnwBEnnHJV6tYnXQrl9n16C9Clj3BD9OjSqGP2PN3UMLmfsJbgZJDD8heJ7RwSxrUE3v1Kag May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 13:06:36.919317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fcb152674fde4beebd5a106495b1ab2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: fcb152674fde4beebd5a106495b1ab2c May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-160524813 May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 563aa380be524bc7970d486ce9ae82c7 May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeTestJSON-160524813-project May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.920807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '53635b2e-ae71-4639-b46e-f532ce5708a5'} May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:06:36.922178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. May 26 13:06:36.923820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:06:36.925240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] Returning 404 to user: Instance 53635b2e-ae71-4639-b46e-f532ce5708a5 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:06:36.925240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a21cc7a9-74f1-417f-9a47-bcddc555b2fa tempest-AttachVolumeTestJSON-160524813 tempest-AttachVolumeTestJSON-160524813-project] 10.222.0.60 "GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5" status: 404 len: 111 microversion: 2.1 time: 0.030716 May 26 13:06:36.925240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 591/1154] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:36 2022] GET /compute/v2.1/servers/53635b2e-ae71-4639-b46e-f532ce5708a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 13:06:37.262258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:06:37.263005 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:06:37.264091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:06:37.264651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:06:37.264966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:06:37.274038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:37.274489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:37.275388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:37.275848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:37.293851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Getting quotas for project 2bbaabf20652434cb79e0652ec678fbb. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:06:37.297949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Getting quotas for user 491ef95e936943d5a144876c2fe22eaf and project 2bbaabf20652434cb79e0652ec678fbb. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:06:37.359091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:06:37.361414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='334ac2cd-fd6b-4961-91e5-2eab6e803805',volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:06:37.838720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f4eee60c-a2f0-4bac-bc56-944d8a00d13e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.074587 May 26 13:06:37.844215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 564/1155] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 13:06:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:06:37.849828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0d942b5a-e686-418c-aaab-f0d4b23a9251 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:37.850450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0d942b5a-e686-418c-aaab-f0d4b23a9251 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:37.905290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0d942b5a-e686-418c-aaab-f0d4b23a9251 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:37.915565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0d942b5a-e686-418c-aaab-f0d4b23a9251 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1094 microversion: 2.1 time: 0.066604 May 26 13:06:37.915565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 592/1156] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:37 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:06:38.929549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94716193-a138-44a2-b637-739a08932645 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:38.930320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94716193-a138-44a2-b637-739a08932645 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:38.940528 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94716193-a138-44a2-b637-739a08932645 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:38.944840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94716193-a138-44a2-b637-739a08932645 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:38.944840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94716193-a138-44a2-b637-739a08932645 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:38.944840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94716193-a138-44a2-b637-739a08932645 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:39.013096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94716193-a138-44a2-b637-739a08932645 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:39.021928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94716193-a138-44a2-b637-739a08932645 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1144 microversion: 2.1 time: 0.096587 May 26 13:06:39.031416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 565/1157] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:38 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:40.039342 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-28dc687c-301d-4011-ac5a-13855d6a6bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:40.040248 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-28dc687c-301d-4011-ac5a-13855d6a6bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:40.066282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28dc687c-301d-4011-ac5a-13855d6a6bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:40.066820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28dc687c-301d-4011-ac5a-13855d6a6bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:40.067622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28dc687c-301d-4011-ac5a-13855d6a6bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:40.068062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28dc687c-301d-4011-ac5a-13855d6a6bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:40.189469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-28dc687c-301d-4011-ac5a-13855d6a6bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:40.200960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-28dc687c-301d-4011-ac5a-13855d6a6bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1192 microversion: 2.1 time: 0.163043 May 26 13:06:40.204186 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 593/1158] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:40 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1192 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:41.227358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3404bd0-59a3-4ea5-8910-bf5bbe8af4e0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:41.227981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3404bd0-59a3-4ea5-8910-bf5bbe8af4e0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:41.235257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3404bd0-59a3-4ea5-8910-bf5bbe8af4e0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:41.235717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3404bd0-59a3-4ea5-8910-bf5bbe8af4e0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:41.236504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3404bd0-59a3-4ea5-8910-bf5bbe8af4e0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:41.236952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3404bd0-59a3-4ea5-8910-bf5bbe8af4e0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:41.318126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3404bd0-59a3-4ea5-8910-bf5bbe8af4e0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:41.330682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3404bd0-59a3-4ea5-8910-bf5bbe8af4e0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1210 microversion: 2.1 time: 0.103281 May 26 13:06:41.330682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 566/1159] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:41 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:42.343862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fc5a75e5-1801-427d-aebf-4f8cf3e029f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:42.344330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fc5a75e5-1801-427d-aebf-4f8cf3e029f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:42.353743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc5a75e5-1801-427d-aebf-4f8cf3e029f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:42.354496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc5a75e5-1801-427d-aebf-4f8cf3e029f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:42.355500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc5a75e5-1801-427d-aebf-4f8cf3e029f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:42.356105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc5a75e5-1801-427d-aebf-4f8cf3e029f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:42.542021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fc5a75e5-1801-427d-aebf-4f8cf3e029f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:42.550834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fc5a75e5-1801-427d-aebf-4f8cf3e029f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.210682 May 26 13:06:42.551401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 594/1160] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:42 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:06:42.609581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-5ac9b5dd-66ba-4c55-bd24-4a1d851f0233 req-2255ad38-88e7-4593-b7b6-b28dbeea50b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf382a59-333a-43e5-9760-6a443183cc3f", "tag": "bbf59772-ad97-4a63-9070-7251df6a9f45"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:06:42.623933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5ac9b5dd-66ba-4c55-bd24-4a1d851f0233 req-2255ad38-88e7-4593-b7b6-b28dbeea50b7 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:42.623933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5ac9b5dd-66ba-4c55-bd24-4a1d851f0233 req-2255ad38-88e7-4593-b7b6-b28dbeea50b7 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:42.638472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-5ac9b5dd-66ba-4c55-bd24-4a1d851f0233 req-2255ad38-88e7-4593-b7b6-b28dbeea50b7 service nova] Creating event network-changed:bbf59772-ad97-4a63-9070-7251df6a9f45 for instance cf382a59-333a-43e5-9760-6a443183cc3f on hv-cinder-81514 May 26 13:06:42.643058 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-5ac9b5dd-66ba-4c55-bd24-4a1d851f0233 req-2255ad38-88e7-4593-b7b6-b28dbeea50b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036923 May 26 13:06:42.643862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 567/1161] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:43.568214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ffa41ed5-590b-4dfd-bf20-a17c17767c44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:43.568825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ffa41ed5-590b-4dfd-bf20-a17c17767c44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:43.575610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffa41ed5-590b-4dfd-bf20-a17c17767c44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:43.576088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffa41ed5-590b-4dfd-bf20-a17c17767c44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:43.576858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffa41ed5-590b-4dfd-bf20-a17c17767c44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:43.577295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffa41ed5-590b-4dfd-bf20-a17c17767c44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:43.795199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ffa41ed5-590b-4dfd-bf20-a17c17767c44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:43.802687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ffa41ed5-590b-4dfd-bf20-a17c17767c44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.238317 May 26 13:06:43.803286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 595/1162] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:43 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:44.820690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c68337d3-08ae-40a4-9e00-1340131f286c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:44.821300 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c68337d3-08ae-40a4-9e00-1340131f286c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:44.824033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:44.829373 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c68337d3-08ae-40a4-9e00-1340131f286c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:44.829942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c68337d3-08ae-40a4-9e00-1340131f286c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:44.830752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c68337d3-08ae-40a4-9e00-1340131f286c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:44.831219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c68337d3-08ae-40a4-9e00-1340131f286c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:44.834113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:44.991127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c68337d3-08ae-40a4-9e00-1340131f286c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:45.001412 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c68337d3-08ae-40a4-9e00-1340131f286c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.185100 May 26 13:06:45.002386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 568/1163] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:44 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:46.021037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f6677f7-1e83-4a59-a462-a55a4f775608 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:46.021663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f6677f7-1e83-4a59-a462-a55a4f775608 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:46.030609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f6677f7-1e83-4a59-a462-a55a4f775608 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:46.031069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f6677f7-1e83-4a59-a462-a55a4f775608 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:46.031880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f6677f7-1e83-4a59-a462-a55a4f775608 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:46.032315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f6677f7-1e83-4a59-a462-a55a4f775608 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:46.170253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f6677f7-1e83-4a59-a462-a55a4f775608 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:46.177906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f6677f7-1e83-4a59-a462-a55a4f775608 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.160809 May 26 13:06:46.178479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 596/1164] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:46 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:47.196487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95495efe-f6fa-4f40-b81c-fe75594f6e1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:47.197708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95495efe-f6fa-4f40-b81c-fe75594f6e1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:47.204855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95495efe-f6fa-4f40-b81c-fe75594f6e1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:47.205316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95495efe-f6fa-4f40-b81c-fe75594f6e1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:47.206094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95495efe-f6fa-4f40-b81c-fe75594f6e1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:47.206557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95495efe-f6fa-4f40-b81c-fe75594f6e1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:47.285283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:47.304954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:47.345703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95495efe-f6fa-4f40-b81c-fe75594f6e1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:47.354663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95495efe-f6fa-4f40-b81c-fe75594f6e1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.162626 May 26 13:06:47.355267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 569/1165] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:47 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:48.373100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40b385b7-3a0a-44ae-b667-534dc9080ffc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:48.373717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40b385b7-3a0a-44ae-b667-534dc9080ffc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:48.376453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:48.382871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b385b7-3a0a-44ae-b667-534dc9080ffc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:48.383325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b385b7-3a0a-44ae-b667-534dc9080ffc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:48.384157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b385b7-3a0a-44ae-b667-534dc9080ffc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:48.385271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b385b7-3a0a-44ae-b667-534dc9080ffc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:48.537675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-40b385b7-3a0a-44ae-b667-534dc9080ffc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:48.545996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40b385b7-3a0a-44ae-b667-534dc9080ffc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.177706 May 26 13:06:48.546800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 597/1166] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:48 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:49.563535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57dc661a-bf8e-4b15-887f-992ab3d193bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:49.564351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57dc661a-bf8e-4b15-887f-992ab3d193bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:49.571462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57dc661a-bf8e-4b15-887f-992ab3d193bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:49.572248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57dc661a-bf8e-4b15-887f-992ab3d193bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:49.573031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57dc661a-bf8e-4b15-887f-992ab3d193bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:49.573467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57dc661a-bf8e-4b15-887f-992ab3d193bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:49.710495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57dc661a-bf8e-4b15-887f-992ab3d193bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:49.718665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57dc661a-bf8e-4b15-887f-992ab3d193bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.158952 May 26 13:06:49.727603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 570/1167] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:49 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:50.736423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3eb4d932-5b55-4c73-8ba7-eef89ddb725a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:50.737030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3eb4d932-5b55-4c73-8ba7-eef89ddb725a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:50.743355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb4d932-5b55-4c73-8ba7-eef89ddb725a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:50.744303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb4d932-5b55-4c73-8ba7-eef89ddb725a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:50.745175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb4d932-5b55-4c73-8ba7-eef89ddb725a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:50.745878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb4d932-5b55-4c73-8ba7-eef89ddb725a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:50.894678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3eb4d932-5b55-4c73-8ba7-eef89ddb725a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:50.903506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3eb4d932-5b55-4c73-8ba7-eef89ddb725a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.170879 May 26 13:06:50.904111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 598/1168] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:50 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:51.922978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1c769ab6-f00d-433d-bd2d-223961a35c0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:51.923588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1c769ab6-f00d-433d-bd2d-223961a35c0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:51.930297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c769ab6-f00d-433d-bd2d-223961a35c0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:51.930788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c769ab6-f00d-433d-bd2d-223961a35c0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:51.932181 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c769ab6-f00d-433d-bd2d-223961a35c0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:51.932618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c769ab6-f00d-433d-bd2d-223961a35c0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:52.072493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1c769ab6-f00d-433d-bd2d-223961a35c0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:52.081602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1c769ab6-f00d-433d-bd2d-223961a35c0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.162362 May 26 13:06:52.083879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 571/1169] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:51 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:53.101795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f53820a-22b1-4376-bbef-b196516958d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:53.101795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f53820a-22b1-4376-bbef-b196516958d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:53.108932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f53820a-22b1-4376-bbef-b196516958d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:53.109415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f53820a-22b1-4376-bbef-b196516958d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:53.110311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f53820a-22b1-4376-bbef-b196516958d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:53.110787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f53820a-22b1-4376-bbef-b196516958d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:53.252702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4f53820a-22b1-4376-bbef-b196516958d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:53.260924 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f53820a-22b1-4376-bbef-b196516958d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.163809 May 26 13:06:53.261503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 599/1170] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:53 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:54.279667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c266091-8057-4427-bfae-125d353644de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:54.280427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c266091-8057-4427-bfae-125d353644de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:54.286673 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c266091-8057-4427-bfae-125d353644de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:54.287163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c266091-8057-4427-bfae-125d353644de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:54.287962 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c266091-8057-4427-bfae-125d353644de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:54.288426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c266091-8057-4427-bfae-125d353644de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:54.428984 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c266091-8057-4427-bfae-125d353644de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:54.437893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c266091-8057-4427-bfae-125d353644de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.163207 May 26 13:06:54.438648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 572/1171] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:54 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:55.015536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-6b9f618c-7712-40a0-8550-04acf2e585b1 req-a1515a86-b767-47ee-939f-a90c48ed36d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf382a59-333a-43e5-9760-6a443183cc3f", "name": "network-vif-plugged", "status": "completed", "tag": "bbf59772-ad97-4a63-9070-7251df6a9f45"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:06:55.036734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6b9f618c-7712-40a0-8550-04acf2e585b1 req-a1515a86-b767-47ee-939f-a90c48ed36d2 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:55.045267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6b9f618c-7712-40a0-8550-04acf2e585b1 req-a1515a86-b767-47ee-939f-a90c48ed36d2 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:55.051679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-6b9f618c-7712-40a0-8550-04acf2e585b1 req-a1515a86-b767-47ee-939f-a90c48ed36d2 service nova] Creating event network-vif-plugged:bbf59772-ad97-4a63-9070-7251df6a9f45 for instance cf382a59-333a-43e5-9760-6a443183cc3f on hv-cinder-81514 May 26 13:06:55.057744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-6b9f618c-7712-40a0-8550-04acf2e585b1 req-a1515a86-b767-47ee-939f-a90c48ed36d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182070 May 26 13:06:55.058355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 600/1172] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:06:55.458939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7977750-ac7b-476e-83e4-f9eec66decfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:55.459940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7977750-ac7b-476e-83e4-f9eec66decfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:55.468500 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7977750-ac7b-476e-83e4-f9eec66decfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:55.468960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7977750-ac7b-476e-83e4-f9eec66decfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:55.469756 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7977750-ac7b-476e-83e4-f9eec66decfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:55.470194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7977750-ac7b-476e-83e4-f9eec66decfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:55.613181 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7977750-ac7b-476e-83e4-f9eec66decfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:55.622369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7977750-ac7b-476e-83e4-f9eec66decfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.170443 May 26 13:06:55.623084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 573/1173] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:55 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:56.640862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-023c6741-2100-41c7-92a8-9489551ec5e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:56.641568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-023c6741-2100-41c7-92a8-9489551ec5e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:56.648033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-023c6741-2100-41c7-92a8-9489551ec5e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:56.648488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-023c6741-2100-41c7-92a8-9489551ec5e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:56.649261 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-023c6741-2100-41c7-92a8-9489551ec5e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:56.649756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-023c6741-2100-41c7-92a8-9489551ec5e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:56.786604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-023c6741-2100-41c7-92a8-9489551ec5e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:56.794757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-023c6741-2100-41c7-92a8-9489551ec5e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1266 microversion: 2.1 time: 0.158492 May 26 13:06:56.795440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 601/1174] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:56 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:57.811487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0a408c32-f56f-4f4e-85a4-216cdb2b54d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:57.812103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0a408c32-f56f-4f4e-85a4-216cdb2b54d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:57.818781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a408c32-f56f-4f4e-85a4-216cdb2b54d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:57.819236 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a408c32-f56f-4f4e-85a4-216cdb2b54d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:57.820011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a408c32-f56f-4f4e-85a4-216cdb2b54d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:57.820455 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a408c32-f56f-4f4e-85a4-216cdb2b54d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:57.956652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0a408c32-f56f-4f4e-85a4-216cdb2b54d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:57.961373 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0a408c32-f56f-4f4e-85a4-216cdb2b54d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1453 microversion: 2.1 time: 0.153781 May 26 13:06:57.961997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 574/1175] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:57 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:06:57.977798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6139ab07-93a7-4d52-9673-5806b386819c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:06:57.978409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6139ab07-93a7-4d52-9673-5806b386819c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:06:57.984860 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6139ab07-93a7-4d52-9673-5806b386819c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:57.985313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6139ab07-93a7-4d52-9673-5806b386819c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:57.986078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6139ab07-93a7-4d52-9673-5806b386819c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:06:57.986517 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6139ab07-93a7-4d52-9673-5806b386819c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:06:58.124877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6139ab07-93a7-4d52-9673-5806b386819c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:06:58.132474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6139ab07-93a7-4d52-9673-5806b386819c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1453 microversion: 2.1 time: 0.158580 May 26 13:06:58.133372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 602/1176] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:06:57 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:07:00.848695 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-637d2abd-e626-462b-ae8a-6fdfb3683a99 req-2ccd5053-b5ba-48da-b973-3a125715e0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf382a59-333a-43e5-9760-6a443183cc3f", "tag": "bbf59772-ad97-4a63-9070-7251df6a9f45"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:07:00.857926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-637d2abd-e626-462b-ae8a-6fdfb3683a99 req-2ccd5053-b5ba-48da-b973-3a125715e0e9 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:07:00.858380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-637d2abd-e626-462b-ae8a-6fdfb3683a99 req-2ccd5053-b5ba-48da-b973-3a125715e0e9 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:07:00.870423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-637d2abd-e626-462b-ae8a-6fdfb3683a99 req-2ccd5053-b5ba-48da-b973-3a125715e0e9 service nova] Creating event network-changed:bbf59772-ad97-4a63-9070-7251df6a9f45 for instance cf382a59-333a-43e5-9760-6a443183cc3f on hv-cinder-81514 May 26 13:07:00.876058 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-637d2abd-e626-462b-ae8a-6fdfb3683a99 req-2ccd5053-b5ba-48da-b973-3a125715e0e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175060 May 26 13:07:00.876781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 575/1177] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:08:21.861514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=27 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:21.862264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=59 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:21.866453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1646741824", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "networks": [{"uuid": "10424dea-7880-4b1e-aef2-54a28db4012f"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:08:22.073803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] validate_networks() for [('10424dea-7880-4b1e-aef2-54a28db4012f', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:08:22.468312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:08:22.468989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:08:22.469401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:08:22.469809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:08:22.470220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:08:22.478984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:22.479493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:22.480287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:22.480720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:22.498225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Getting quotas for project 9b22744f23304e41b1c3a5d2bc0afdb9. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:08:22.502166 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Getting quotas for user d9fc5cfd0a50441c9fd9116a7b5c514a and project 9b22744f23304e41b1c3a5d2bc0afdb9. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:08:22.513516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:08:22.516634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:08:22.652918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [8b369ab4-8635-459d-bab8-6555c60d0b13] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 13:08:23.662559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [8b369ab4-8635-459d-bab8-6555c60d0b13] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53218. May 26 13:08:23.666385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dfa6125a-c9f0-495c-8785-99921a4f4526 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806969 May 26 13:08:23.667186 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 603/1178] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 13:08:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 13:08:23.676538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=15 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:23.677372 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=43 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:23.681907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ece5d9e2-6657-4021-91d8-11a1874604b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:23.682635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ece5d9e2-6657-4021-91d8-11a1874604b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:23.793209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ece5d9e2-6657-4021-91d8-11a1874604b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:23.799893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ece5d9e2-6657-4021-91d8-11a1874604b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1219 microversion: 2.1 time: 0.125690 May 26 13:08:23.800447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 576/1179] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:23 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:24.818339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c49766cf-e6c9-47ee-b4ba-950e3c588068 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:24.818986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c49766cf-e6c9-47ee-b4ba-950e3c588068 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:24.872009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c49766cf-e6c9-47ee-b4ba-950e3c588068 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:24.880277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c49766cf-e6c9-47ee-b4ba-950e3c588068 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1219 microversion: 2.1 time: 0.066321 May 26 13:08:24.880834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 604/1180] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:24 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:08:25.897336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b758ee5-5bfc-4eae-bf12-e0835b2ec6ba tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:25.897959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b758ee5-5bfc-4eae-bf12-e0835b2ec6ba tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:25.951924 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b758ee5-5bfc-4eae-bf12-e0835b2ec6ba tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:25.960678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b758ee5-5bfc-4eae-bf12-e0835b2ec6ba tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1219 microversion: 2.1 time: 0.067326 May 26 13:08:25.961237 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 577/1181] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:25 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:26.978395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af5a63e2-6792-4435-842d-f71c28e0b03f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:26.979025 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af5a63e2-6792-4435-842d-f71c28e0b03f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:27.037107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af5a63e2-6792-4435-842d-f71c28e0b03f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:27.044111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af5a63e2-6792-4435-842d-f71c28e0b03f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1219 microversion: 2.1 time: 0.069659 May 26 13:08:27.044694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 605/1182] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:26 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:28.061800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d9fc6a2-844d-40fb-9530-07fba634979d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:28.064456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d9fc6a2-844d-40fb-9530-07fba634979d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:28.072260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9fc6a2-844d-40fb-9530-07fba634979d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:28.072714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9fc6a2-844d-40fb-9530-07fba634979d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:28.073751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9fc6a2-844d-40fb-9530-07fba634979d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:28.074494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9fc6a2-844d-40fb-9530-07fba634979d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:28.160185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d9fc6a2-844d-40fb-9530-07fba634979d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:28.174447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d9fc6a2-844d-40fb-9530-07fba634979d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1223 microversion: 2.1 time: 0.116369 May 26 13:08:28.175656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 578/1183] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:28 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:29.197370 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a08bd321-1f9a-4173-96ab-07d4ad3ef9f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:29.199119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a08bd321-1f9a-4173-96ab-07d4ad3ef9f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:29.212201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a08bd321-1f9a-4173-96ab-07d4ad3ef9f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:29.218031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a08bd321-1f9a-4173-96ab-07d4ad3ef9f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:29.218031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a08bd321-1f9a-4173-96ab-07d4ad3ef9f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:29.218031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a08bd321-1f9a-4173-96ab-07d4ad3ef9f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:29.285621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a08bd321-1f9a-4173-96ab-07d4ad3ef9f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:29.297998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a08bd321-1f9a-4173-96ab-07d4ad3ef9f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1223 microversion: 2.1 time: 0.107850 May 26 13:08:29.303133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 606/1184] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:29 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:08:30.316307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c511ddab-579a-4d7b-ab96-c136f13ba557 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:30.316914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c511ddab-579a-4d7b-ab96-c136f13ba557 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:30.323741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c511ddab-579a-4d7b-ab96-c136f13ba557 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:30.324263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c511ddab-579a-4d7b-ab96-c136f13ba557 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:30.325039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c511ddab-579a-4d7b-ab96-c136f13ba557 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:30.325472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c511ddab-579a-4d7b-ab96-c136f13ba557 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:30.402909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c511ddab-579a-4d7b-ab96-c136f13ba557 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:30.410721 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c511ddab-579a-4d7b-ab96-c136f13ba557 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1279 microversion: 2.1 time: 0.098929 May 26 13:08:30.411496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 579/1185] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:30 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:31.434759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-422974f1-0b17-43eb-b990-ee04f3a808c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:31.436069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-422974f1-0b17-43eb-b990-ee04f3a808c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:31.443260 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-422974f1-0b17-43eb-b990-ee04f3a808c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:31.443706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-422974f1-0b17-43eb-b990-ee04f3a808c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:31.444520 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-422974f1-0b17-43eb-b990-ee04f3a808c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:31.444958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-422974f1-0b17-43eb-b990-ee04f3a808c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:31.644032 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-422974f1-0b17-43eb-b990-ee04f3a808c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:31.651945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-422974f1-0b17-43eb-b990-ee04f3a808c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1319 microversion: 2.1 time: 0.221628 May 26 13:08:31.652550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 607/1186] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:31 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:32.126464 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-fd0b5928-6cd8-4ea7-8f91-efdb73387ca7 req-6d1ea548-f8e0-4c89-a651-9c30309de7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a03f3c20-ca70-497d-a163-d7c152799be2", "tag": "6d4892f1-7c31-4c2e-af66-724484c5f5dc"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:08:32.135680 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-fd0b5928-6cd8-4ea7-8f91-efdb73387ca7 req-6d1ea548-f8e0-4c89-a651-9c30309de7bc service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:32.136182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-fd0b5928-6cd8-4ea7-8f91-efdb73387ca7 req-6d1ea548-f8e0-4c89-a651-9c30309de7bc service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:32.160448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-fd0b5928-6cd8-4ea7-8f91-efdb73387ca7 req-6d1ea548-f8e0-4c89-a651-9c30309de7bc service nova] Creating event network-changed:6d4892f1-7c31-4c2e-af66-724484c5f5dc for instance a03f3c20-ca70-497d-a163-d7c152799be2 on hv-cinder-81514 May 26 13:08:32.165620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-fd0b5928-6cd8-4ea7-8f91-efdb73387ca7 req-6d1ea548-f8e0-4c89-a651-9c30309de7bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043778 May 26 13:08:32.166223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 580/1187] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:08:32.669481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6bee3231-96fa-4bc5-94ca-79246778d1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:32.670207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6bee3231-96fa-4bc5-94ca-79246778d1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:32.673590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:32.678656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6bee3231-96fa-4bc5-94ca-79246778d1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:32.683841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6bee3231-96fa-4bc5-94ca-79246778d1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:32.683841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6bee3231-96fa-4bc5-94ca-79246778d1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:32.683841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6bee3231-96fa-4bc5-94ca-79246778d1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:32.927662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6bee3231-96fa-4bc5-94ca-79246778d1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:32.936788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6bee3231-96fa-4bc5-94ca-79246778d1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1319 microversion: 2.1 time: 0.271114 May 26 13:08:32.937940 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 608/1188] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:32 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:33.956858 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-400fdf86-6eb6-4fc8-8b3e-ce2fa9a991ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:33.957581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-400fdf86-6eb6-4fc8-8b3e-ce2fa9a991ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:33.964656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-400fdf86-6eb6-4fc8-8b3e-ce2fa9a991ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:33.965096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-400fdf86-6eb6-4fc8-8b3e-ce2fa9a991ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:33.965873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-400fdf86-6eb6-4fc8-8b3e-ce2fa9a991ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:33.966302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-400fdf86-6eb6-4fc8-8b3e-ce2fa9a991ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:34.102909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-400fdf86-6eb6-4fc8-8b3e-ce2fa9a991ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:34.110697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-400fdf86-6eb6-4fc8-8b3e-ce2fa9a991ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1319 microversion: 2.1 time: 0.159146 May 26 13:08:34.111278 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 581/1189] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:33 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:35.128904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7aa36076-902e-4965-8460-c45eb78d7d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:35.130188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7aa36076-902e-4965-8460-c45eb78d7d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:35.136940 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aa36076-902e-4965-8460-c45eb78d7d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:35.137424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aa36076-902e-4965-8460-c45eb78d7d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:35.138200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aa36076-902e-4965-8460-c45eb78d7d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:35.138716 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aa36076-902e-4965-8460-c45eb78d7d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:35.293672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7aa36076-902e-4965-8460-c45eb78d7d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:35.302007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7aa36076-902e-4965-8460-c45eb78d7d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1319 microversion: 2.1 time: 0.177493 May 26 13:08:35.302800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 609/1190] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:35 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:36.318586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3d622ccd-17ea-47ea-b013-95e7c4d59856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:36.319458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3d622ccd-17ea-47ea-b013-95e7c4d59856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:36.321628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:36.326694 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d622ccd-17ea-47ea-b013-95e7c4d59856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:36.327156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d622ccd-17ea-47ea-b013-95e7c4d59856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:36.328051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d622ccd-17ea-47ea-b013-95e7c4d59856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:36.328505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d622ccd-17ea-47ea-b013-95e7c4d59856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:36.484252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3d622ccd-17ea-47ea-b013-95e7c4d59856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:36.494544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3d622ccd-17ea-47ea-b013-95e7c4d59856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1319 microversion: 2.1 time: 0.179786 May 26 13:08:36.495141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 582/1191] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:36 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:37.471896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-42d1e2fc-9317-4763-947b-1d15551fa915 req-041534b7-4776-47cf-b90c-46d9ed04905e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03f3c20-ca70-497d-a163-d7c152799be2", "name": "network-vif-plugged", "status": "completed", "tag": "6d4892f1-7c31-4c2e-af66-724484c5f5dc"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:08:37.476156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:37.483031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-42d1e2fc-9317-4763-947b-1d15551fa915 req-041534b7-4776-47cf-b90c-46d9ed04905e service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:37.483494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-42d1e2fc-9317-4763-947b-1d15551fa915 req-041534b7-4776-47cf-b90c-46d9ed04905e service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:37.496598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-42d1e2fc-9317-4763-947b-1d15551fa915 req-041534b7-4776-47cf-b90c-46d9ed04905e service nova] Creating event network-vif-plugged:6d4892f1-7c31-4c2e-af66-724484c5f5dc for instance a03f3c20-ca70-497d-a163-d7c152799be2 on hv-cinder-81514 May 26 13:08:37.502810 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-42d1e2fc-9317-4763-947b-1d15551fa915 req-041534b7-4776-47cf-b90c-46d9ed04905e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034602 May 26 13:08:37.503413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 610/1192] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:08:37.517263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d2fbc03a-34a4-4bce-85ca-e42898903934 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:37.518042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d2fbc03a-34a4-4bce-85ca-e42898903934 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:37.524948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2fbc03a-34a4-4bce-85ca-e42898903934 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:37.529598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2fbc03a-34a4-4bce-85ca-e42898903934 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:37.529598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2fbc03a-34a4-4bce-85ca-e42898903934 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:37.529598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2fbc03a-34a4-4bce-85ca-e42898903934 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:37.694844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d2fbc03a-34a4-4bce-85ca-e42898903934 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:37.703226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d2fbc03a-34a4-4bce-85ca-e42898903934 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1319 microversion: 2.1 time: 0.190033 May 26 13:08:37.703985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 583/1193] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:37 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:38.722126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d410631-057d-49c0-a309-c6a58568635c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:38.722855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d410631-057d-49c0-a309-c6a58568635c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:38.729226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d410631-057d-49c0-a309-c6a58568635c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:38.729673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d410631-057d-49c0-a309-c6a58568635c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:38.730433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d410631-057d-49c0-a309-c6a58568635c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:38.730890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d410631-057d-49c0-a309-c6a58568635c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:38.870320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d410631-057d-49c0-a309-c6a58568635c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:38.878782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d410631-057d-49c0-a309-c6a58568635c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1319 microversion: 2.1 time: 0.161776 May 26 13:08:38.879361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 611/1194] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:38 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:39.896617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3aa942b3-15d0-4c43-8b11-b9b2ee2233fa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:39.897359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3aa942b3-15d0-4c43-8b11-b9b2ee2233fa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:39.904167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3aa942b3-15d0-4c43-8b11-b9b2ee2233fa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:39.904621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3aa942b3-15d0-4c43-8b11-b9b2ee2233fa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:39.905421 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3aa942b3-15d0-4c43-8b11-b9b2ee2233fa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:39.905879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3aa942b3-15d0-4c43-8b11-b9b2ee2233fa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:40.038093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3aa942b3-15d0-4c43-8b11-b9b2ee2233fa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:40.045509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3aa942b3-15d0-4c43-8b11-b9b2ee2233fa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1319 microversion: 2.1 time: 0.154015 May 26 13:08:40.046095 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 584/1195] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:39 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:08:41.064356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b4994f69-ddda-4aa4-abea-6f5dc80721b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:08:41.065086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b4994f69-ddda-4aa4-abea-6f5dc80721b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:08:41.071654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4994f69-ddda-4aa4-abea-6f5dc80721b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:41.072124 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4994f69-ddda-4aa4-abea-6f5dc80721b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:41.072887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4994f69-ddda-4aa4-abea-6f5dc80721b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:08:41.073322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4994f69-ddda-4aa4-abea-6f5dc80721b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:08:41.206289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b4994f69-ddda-4aa4-abea-6f5dc80721b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:08:41.213917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b4994f69-ddda-4aa4-abea-6f5dc80721b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1508 microversion: 2.1 time: 0.154284 May 26 13:08:41.214553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 612/1196] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:08:41 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:01.911631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc71bf48-ef9c-468f-af81-e8a2c75ddbaa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b982ab7e-ccb7-4fd6-940c-be9867d4484c", "device": "/dev/sdb"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:09:01.913210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc71bf48-ef9c-468f-af81-e8a2c75ddbaa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:01.915386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=22 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:01.916058 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=38 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:01.922980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc71bf48-ef9c-468f-af81-e8a2c75ddbaa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:01.926926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc71bf48-ef9c-468f-af81-e8a2c75ddbaa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:01.926926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc71bf48-ef9c-468f-af81-e8a2c75ddbaa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:01.926926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc71bf48-ef9c-468f-af81-e8a2c75ddbaa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:02.575094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc71bf48-ef9c-468f-af81-e8a2c75ddbaa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "POST /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670141 May 26 13:09:02.575611 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 585/1197] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 13:09:01 2022] POST /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:09:16.160440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6db8105-3084-42a2-a882-40b9ad233f77 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:16.161008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6db8105-3084-42a2-a882-40b9ad233f77 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:16.163692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:16.164443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:16.167479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:16.168369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=40 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:16.168504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-20fdc439-9b0a-4b16-b986-3615f55b6919 req-e265cb1e-6b9d-4d58-bf37-b60420ed48ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf382a59-333a-43e5-9760-6a443183cc3f", "tag": "bbf59772-ad97-4a63-9070-7251df6a9f45"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:09:16.169972 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6db8105-3084-42a2-a882-40b9ad233f77 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:16.170414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6db8105-3084-42a2-a882-40b9ad233f77 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:16.171210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6db8105-3084-42a2-a882-40b9ad233f77 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:16.171655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6db8105-3084-42a2-a882-40b9ad233f77 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:16.177585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-20fdc439-9b0a-4b16-b986-3615f55b6919 req-e265cb1e-6b9d-4d58-bf37-b60420ed48ea service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:16.178039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-20fdc439-9b0a-4b16-b986-3615f55b6919 req-e265cb1e-6b9d-4d58-bf37-b60420ed48ea service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:16.189586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-20fdc439-9b0a-4b16-b986-3615f55b6919 req-e265cb1e-6b9d-4d58-bf37-b60420ed48ea service nova] Creating event network-changed:bbf59772-ad97-4a63-9070-7251df6a9f45 for instance cf382a59-333a-43e5-9760-6a443183cc3f on hv-cinder-81514 May 26 13:09:16.195474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-20fdc439-9b0a-4b16-b986-3615f55b6919 req-e265cb1e-6b9d-4d58-bf37-b60420ed48ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033062 May 26 13:09:16.196388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 586/1198] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:09:16.200220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6db8105-3084-42a2-a882-40b9ad233f77 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:09:16.530789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f6db8105-3084-42a2-a882-40b9ad233f77 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 204 len: 0 microversion: 2.1 time: 0.374811 May 26 13:09:16.531458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 613/1199] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:09:16 2022] DELETE /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:09:16.542772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ae189c5-3bdf-40a9-8d90-715093dd6f38 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:16.543494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ae189c5-3bdf-40a9-8d90-715093dd6f38 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:16.551410 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ae189c5-3bdf-40a9-8d90-715093dd6f38 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:16.551872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ae189c5-3bdf-40a9-8d90-715093dd6f38 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:16.552961 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ae189c5-3bdf-40a9-8d90-715093dd6f38 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:16.553120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ae189c5-3bdf-40a9-8d90-715093dd6f38 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:16.712143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ae189c5-3bdf-40a9-8d90-715093dd6f38 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:16.720164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ae189c5-3bdf-40a9-8d90-715093dd6f38 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1577 microversion: 2.1 time: 0.183290 May 26 13:09:16.721265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 587/1200] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:16 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:17.740681 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5efd4a07-f63c-4dc6-936c-6c854ef0a3f6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:17.741390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5efd4a07-f63c-4dc6-936c-6c854ef0a3f6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:17.748016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5efd4a07-f63c-4dc6-936c-6c854ef0a3f6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:17.748475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5efd4a07-f63c-4dc6-936c-6c854ef0a3f6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:17.749262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5efd4a07-f63c-4dc6-936c-6c854ef0a3f6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:17.749702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5efd4a07-f63c-4dc6-936c-6c854ef0a3f6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:17.968752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5efd4a07-f63c-4dc6-936c-6c854ef0a3f6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:17.969325 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:09:17.969809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:09:17.977749 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5efd4a07-f63c-4dc6-936c-6c854ef0a3f6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1577 microversion: 2.1 time: 0.241636 May 26 13:09:17.982706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 614/1201] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:17 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:18.995213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5454716a-ddd0-4474-b1e0-dd9e34000435 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:18.995955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5454716a-ddd0-4474-b1e0-dd9e34000435 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:19.005002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5454716a-ddd0-4474-b1e0-dd9e34000435 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:19.005002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5454716a-ddd0-4474-b1e0-dd9e34000435 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:19.008806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5454716a-ddd0-4474-b1e0-dd9e34000435 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:19.008806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5454716a-ddd0-4474-b1e0-dd9e34000435 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:19.033830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-f795045c-5231-4ee2-936d-51e1ec93f76f req-1bb594ab-f2ec-4481-a87e-bb8d3046b616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf382a59-333a-43e5-9760-6a443183cc3f", "name": "network-vif-deleted", "tag": "bbf59772-ad97-4a63-9070-7251df6a9f45"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:09:19.042667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f795045c-5231-4ee2-936d-51e1ec93f76f req-1bb594ab-f2ec-4481-a87e-bb8d3046b616 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:19.046553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f795045c-5231-4ee2-936d-51e1ec93f76f req-1bb594ab-f2ec-4481-a87e-bb8d3046b616 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:19.060139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-f795045c-5231-4ee2-936d-51e1ec93f76f req-1bb594ab-f2ec-4481-a87e-bb8d3046b616 service nova] Creating event network-vif-deleted:bbf59772-ad97-4a63-9070-7251df6a9f45 for instance cf382a59-333a-43e5-9760-6a443183cc3f on hv-cinder-81514 May 26 13:09:19.065043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-f795045c-5231-4ee2-936d-51e1ec93f76f req-1bb594ab-f2ec-4481-a87e-bb8d3046b616 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035679 May 26 13:09:19.065647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 615/1202] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:09:19.075504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5454716a-ddd0-4474-b1e0-dd9e34000435 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:19.084049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5454716a-ddd0-4474-b1e0-dd9e34000435 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1391 microversion: 2.1 time: 0.093081 May 26 13:09:19.085049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 588/1203] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:18 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:20.102780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-208df1ec-43ef-449c-8030-51c863d3ef3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:20.105228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-208df1ec-43ef-449c-8030-51c863d3ef3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:20.110463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-208df1ec-43ef-449c-8030-51c863d3ef3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:20.110964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-208df1ec-43ef-449c-8030-51c863d3ef3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:20.111966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-208df1ec-43ef-449c-8030-51c863d3ef3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:20.112531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-208df1ec-43ef-449c-8030-51c863d3ef3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:20.191013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-208df1ec-43ef-449c-8030-51c863d3ef3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:20.198750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-208df1ec-43ef-449c-8030-51c863d3ef3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.100177 May 26 13:09:20.199336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 616/1204] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:20 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:21.216295 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1baf72b-3046-40fb-93f1-e3b9499813ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:21.216902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1baf72b-3046-40fb-93f1-e3b9499813ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:21.223761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1baf72b-3046-40fb-93f1-e3b9499813ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:21.224212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1baf72b-3046-40fb-93f1-e3b9499813ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:21.225398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1baf72b-3046-40fb-93f1-e3b9499813ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:21.225398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1baf72b-3046-40fb-93f1-e3b9499813ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:21.288469 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1baf72b-3046-40fb-93f1-e3b9499813ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:21.296519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1baf72b-3046-40fb-93f1-e3b9499813ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083999 May 26 13:09:21.297092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 589/1205] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:21 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:22.318929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-32715738-5246-4364-b35d-4680edaa0845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:22.319605 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-32715738-5246-4364-b35d-4680edaa0845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:22.325967 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32715738-5246-4364-b35d-4680edaa0845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:22.326412 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32715738-5246-4364-b35d-4680edaa0845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:22.327204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32715738-5246-4364-b35d-4680edaa0845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:22.327639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32715738-5246-4364-b35d-4680edaa0845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:22.388297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-32715738-5246-4364-b35d-4680edaa0845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:22.400073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-32715738-5246-4364-b35d-4680edaa0845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087374 May 26 13:09:22.402454 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 617/1206] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:22 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:23.416930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-962e474f-06f3-4c92-bf7a-16a70d371358 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:23.417539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-962e474f-06f3-4c92-bf7a-16a70d371358 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:23.424207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-962e474f-06f3-4c92-bf7a-16a70d371358 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:23.424690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-962e474f-06f3-4c92-bf7a-16a70d371358 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:23.425457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-962e474f-06f3-4c92-bf7a-16a70d371358 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:23.425892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-962e474f-06f3-4c92-bf7a-16a70d371358 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:23.491606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-962e474f-06f3-4c92-bf7a-16a70d371358 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:23.499832 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-962e474f-06f3-4c92-bf7a-16a70d371358 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086859 May 26 13:09:23.500409 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 590/1207] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:23 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:24.517094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3bfdc2ed-724a-4237-bc42-978d7dcf11a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:24.518387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3bfdc2ed-724a-4237-bc42-978d7dcf11a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:24.525190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3bfdc2ed-724a-4237-bc42-978d7dcf11a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:24.525643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3bfdc2ed-724a-4237-bc42-978d7dcf11a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:24.526413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3bfdc2ed-724a-4237-bc42-978d7dcf11a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:24.526882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3bfdc2ed-724a-4237-bc42-978d7dcf11a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:24.590415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3bfdc2ed-724a-4237-bc42-978d7dcf11a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:24.599400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3bfdc2ed-724a-4237-bc42-978d7dcf11a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085866 May 26 13:09:24.599728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 618/1208] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:24 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:24.931844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:09:24.932417 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:09:25.616931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b82fed73-13fb-4c92-9197-6750339293af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:25.617459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b82fed73-13fb-4c92-9197-6750339293af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:25.624131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b82fed73-13fb-4c92-9197-6750339293af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:25.624615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b82fed73-13fb-4c92-9197-6750339293af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:25.628218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b82fed73-13fb-4c92-9197-6750339293af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:25.628218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b82fed73-13fb-4c92-9197-6750339293af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:25.698470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b82fed73-13fb-4c92-9197-6750339293af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:25.708718 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b82fed73-13fb-4c92-9197-6750339293af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.095871 May 26 13:09:25.709338 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 591/1209] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:25 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:26.728858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-11e69a28-7089-4bf8-aa2c-25f0f55e9e6c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:26.729510 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-11e69a28-7089-4bf8-aa2c-25f0f55e9e6c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:26.737139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11e69a28-7089-4bf8-aa2c-25f0f55e9e6c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:26.737722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11e69a28-7089-4bf8-aa2c-25f0f55e9e6c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:26.738803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11e69a28-7089-4bf8-aa2c-25f0f55e9e6c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:26.739245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11e69a28-7089-4bf8-aa2c-25f0f55e9e6c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:26.802244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-11e69a28-7089-4bf8-aa2c-25f0f55e9e6c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:26.810109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-11e69a28-7089-4bf8-aa2c-25f0f55e9e6c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085088 May 26 13:09:26.810720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 619/1210] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:26 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:27.827290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d0dc12c-7535-497f-b15c-67a0d45f4c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:27.827885 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d0dc12c-7535-497f-b15c-67a0d45f4c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:27.835183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0dc12c-7535-497f-b15c-67a0d45f4c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:27.835630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0dc12c-7535-497f-b15c-67a0d45f4c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:27.836393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0dc12c-7535-497f-b15c-67a0d45f4c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:27.836830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0dc12c-7535-497f-b15c-67a0d45f4c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:27.898647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d0dc12c-7535-497f-b15c-67a0d45f4c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:27.906245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d0dc12c-7535-497f-b15c-67a0d45f4c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082877 May 26 13:09:27.906849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 592/1211] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:27 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:28.923389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff3af4d9-44a5-47d6-81ee-db40ddc2db03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:28.924584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff3af4d9-44a5-47d6-81ee-db40ddc2db03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:28.930791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff3af4d9-44a5-47d6-81ee-db40ddc2db03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:28.940169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff3af4d9-44a5-47d6-81ee-db40ddc2db03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:28.940169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff3af4d9-44a5-47d6-81ee-db40ddc2db03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:28.940169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff3af4d9-44a5-47d6-81ee-db40ddc2db03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:28.999926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff3af4d9-44a5-47d6-81ee-db40ddc2db03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:29.009269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff3af4d9-44a5-47d6-81ee-db40ddc2db03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089901 May 26 13:09:29.009858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 620/1212] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:28 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:30.026817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d37211a7-b43b-48a3-b292-f3e74375e108 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:30.027423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d37211a7-b43b-48a3-b292-f3e74375e108 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:30.034868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d37211a7-b43b-48a3-b292-f3e74375e108 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:30.035330 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d37211a7-b43b-48a3-b292-f3e74375e108 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:30.036109 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d37211a7-b43b-48a3-b292-f3e74375e108 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:30.036552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d37211a7-b43b-48a3-b292-f3e74375e108 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:30.103303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d37211a7-b43b-48a3-b292-f3e74375e108 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:30.110885 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d37211a7-b43b-48a3-b292-f3e74375e108 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087979 May 26 13:09:30.112063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 593/1213] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:30 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:31.129691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4bab0004-6949-4c60-946f-7aaef4131ec0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:31.130813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4bab0004-6949-4c60-946f-7aaef4131ec0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:31.137734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bab0004-6949-4c60-946f-7aaef4131ec0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:31.138180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bab0004-6949-4c60-946f-7aaef4131ec0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:31.138974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bab0004-6949-4c60-946f-7aaef4131ec0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:31.139406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bab0004-6949-4c60-946f-7aaef4131ec0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:31.208818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4bab0004-6949-4c60-946f-7aaef4131ec0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:31.216906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4bab0004-6949-4c60-946f-7aaef4131ec0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092028 May 26 13:09:31.217487 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 621/1214] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:31 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:32.233265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f58d2bd-3820-42f8-aecd-65cbcb6ebc35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:32.233873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f58d2bd-3820-42f8-aecd-65cbcb6ebc35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:32.240937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f58d2bd-3820-42f8-aecd-65cbcb6ebc35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:32.241394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f58d2bd-3820-42f8-aecd-65cbcb6ebc35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:32.242163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f58d2bd-3820-42f8-aecd-65cbcb6ebc35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:32.242631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f58d2bd-3820-42f8-aecd-65cbcb6ebc35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:32.303830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f58d2bd-3820-42f8-aecd-65cbcb6ebc35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:32.311354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f58d2bd-3820-42f8-aecd-65cbcb6ebc35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081953 May 26 13:09:32.311916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 594/1215] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:32 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:33.329250 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a24069f-cd1e-4b49-93d4-d08e5f39c291 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:33.329857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a24069f-cd1e-4b49-93d4-d08e5f39c291 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:33.337139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a24069f-cd1e-4b49-93d4-d08e5f39c291 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:33.337673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a24069f-cd1e-4b49-93d4-d08e5f39c291 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:33.338496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a24069f-cd1e-4b49-93d4-d08e5f39c291 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:33.338966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a24069f-cd1e-4b49-93d4-d08e5f39c291 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:33.402161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a24069f-cd1e-4b49-93d4-d08e5f39c291 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:33.410009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a24069f-cd1e-4b49-93d4-d08e5f39c291 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084955 May 26 13:09:33.410641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 622/1216] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:33 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:34.429376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6b584421-3f9c-4d85-96c0-085e1da61748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:34.429998 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6b584421-3f9c-4d85-96c0-085e1da61748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:34.437834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b584421-3f9c-4d85-96c0-085e1da61748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:34.438698 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b584421-3f9c-4d85-96c0-085e1da61748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:34.440090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b584421-3f9c-4d85-96c0-085e1da61748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:34.440872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b584421-3f9c-4d85-96c0-085e1da61748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:34.507908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6b584421-3f9c-4d85-96c0-085e1da61748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:34.515510 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6b584421-3f9c-4d85-96c0-085e1da61748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090897 May 26 13:09:34.516075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 595/1217] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:34 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:35.532841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb3784c0-cc00-4681-9921-119ac6bcdbd2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:35.533423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb3784c0-cc00-4681-9921-119ac6bcdbd2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:35.540925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb3784c0-cc00-4681-9921-119ac6bcdbd2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:35.541379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb3784c0-cc00-4681-9921-119ac6bcdbd2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:35.542227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb3784c0-cc00-4681-9921-119ac6bcdbd2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:35.542695 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb3784c0-cc00-4681-9921-119ac6bcdbd2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:35.605663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb3784c0-cc00-4681-9921-119ac6bcdbd2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:35.613646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb3784c0-cc00-4681-9921-119ac6bcdbd2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085124 May 26 13:09:35.614218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 623/1218] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:35 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:36.630496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2be63dd0-182b-4ce3-85f3-f26b08f2ada5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:36.631191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2be63dd0-182b-4ce3-85f3-f26b08f2ada5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:36.637887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2be63dd0-182b-4ce3-85f3-f26b08f2ada5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:36.638347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2be63dd0-182b-4ce3-85f3-f26b08f2ada5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:36.639152 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2be63dd0-182b-4ce3-85f3-f26b08f2ada5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:36.639598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2be63dd0-182b-4ce3-85f3-f26b08f2ada5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:36.700836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2be63dd0-182b-4ce3-85f3-f26b08f2ada5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:36.708438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2be63dd0-182b-4ce3-85f3-f26b08f2ada5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081933 May 26 13:09:36.709010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 596/1219] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:36 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:37.725073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-28c008df-69ad-44e6-a2e0-8815bee67e0a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:37.725691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-28c008df-69ad-44e6-a2e0-8815bee67e0a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:37.732253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28c008df-69ad-44e6-a2e0-8815bee67e0a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:37.732711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28c008df-69ad-44e6-a2e0-8815bee67e0a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:37.733493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28c008df-69ad-44e6-a2e0-8815bee67e0a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:37.733940 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28c008df-69ad-44e6-a2e0-8815bee67e0a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:37.797365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-28c008df-69ad-44e6-a2e0-8815bee67e0a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:37.805759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-28c008df-69ad-44e6-a2e0-8815bee67e0a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084468 May 26 13:09:37.806334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 624/1220] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:37 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:38.822964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d157a55-1fd7-4409-a436-7055f2364dec tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:38.823578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d157a55-1fd7-4409-a436-7055f2364dec tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:38.830153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d157a55-1fd7-4409-a436-7055f2364dec tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:38.830630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d157a55-1fd7-4409-a436-7055f2364dec tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:38.831397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d157a55-1fd7-4409-a436-7055f2364dec tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:38.831838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d157a55-1fd7-4409-a436-7055f2364dec tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:38.904035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d157a55-1fd7-4409-a436-7055f2364dec tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:38.911631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d157a55-1fd7-4409-a436-7055f2364dec tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092441 May 26 13:09:38.912194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 597/1221] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:38 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:39.928608 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c54eb13-63ba-4e32-a2a2-e27a45809418 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:39.929193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c54eb13-63ba-4e32-a2a2-e27a45809418 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:39.935673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c54eb13-63ba-4e32-a2a2-e27a45809418 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:39.936119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c54eb13-63ba-4e32-a2a2-e27a45809418 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:39.936871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c54eb13-63ba-4e32-a2a2-e27a45809418 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:39.937305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c54eb13-63ba-4e32-a2a2-e27a45809418 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:39.998237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c54eb13-63ba-4e32-a2a2-e27a45809418 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:40.006199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c54eb13-63ba-4e32-a2a2-e27a45809418 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081794 May 26 13:09:40.006849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 625/1222] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:39 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:41.023206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-596c7467-de7f-4143-8cd6-b9311129632b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:41.023915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-596c7467-de7f-4143-8cd6-b9311129632b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:41.030507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-596c7467-de7f-4143-8cd6-b9311129632b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:41.030924 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-596c7467-de7f-4143-8cd6-b9311129632b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:41.031688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-596c7467-de7f-4143-8cd6-b9311129632b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:41.032120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-596c7467-de7f-4143-8cd6-b9311129632b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:41.096978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-596c7467-de7f-4143-8cd6-b9311129632b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:41.105327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-596c7467-de7f-4143-8cd6-b9311129632b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086061 May 26 13:09:41.105892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 598/1223] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:41 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:42.123261 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a778b725-246b-47c1-8276-281ef12cc011 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:42.123904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a778b725-246b-47c1-8276-281ef12cc011 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:42.131420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a778b725-246b-47c1-8276-281ef12cc011 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:42.131956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a778b725-246b-47c1-8276-281ef12cc011 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:42.132758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a778b725-246b-47c1-8276-281ef12cc011 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:42.133201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a778b725-246b-47c1-8276-281ef12cc011 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:42.199314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a778b725-246b-47c1-8276-281ef12cc011 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:42.207541 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a778b725-246b-47c1-8276-281ef12cc011 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088192 May 26 13:09:42.208120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 626/1224] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:42 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:43.225803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dad93c31-2353-4230-9864-79a5017c6315 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:43.226423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dad93c31-2353-4230-9864-79a5017c6315 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:43.232979 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad93c31-2353-4230-9864-79a5017c6315 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:43.233439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad93c31-2353-4230-9864-79a5017c6315 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:43.234212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad93c31-2353-4230-9864-79a5017c6315 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:43.234685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad93c31-2353-4230-9864-79a5017c6315 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:43.299716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dad93c31-2353-4230-9864-79a5017c6315 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:43.307371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dad93c31-2353-4230-9864-79a5017c6315 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086148 May 26 13:09:43.307939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 599/1225] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:43 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:44.324373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d2e9763-9744-4951-9983-278ac103cc08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:44.324986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d2e9763-9744-4951-9983-278ac103cc08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:44.331509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d2e9763-9744-4951-9983-278ac103cc08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:44.331958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d2e9763-9744-4951-9983-278ac103cc08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:44.332828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d2e9763-9744-4951-9983-278ac103cc08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:44.333182 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d2e9763-9744-4951-9983-278ac103cc08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:44.397795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7d2e9763-9744-4951-9983-278ac103cc08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:44.407456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d2e9763-9744-4951-9983-278ac103cc08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085162 May 26 13:09:44.407456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 627/1226] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:44 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:45.423060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8b3dfa8d-3466-4f11-b443-67aab6c485b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:45.423669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8b3dfa8d-3466-4f11-b443-67aab6c485b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:45.430374 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b3dfa8d-3466-4f11-b443-67aab6c485b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:45.430846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b3dfa8d-3466-4f11-b443-67aab6c485b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:45.431631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b3dfa8d-3466-4f11-b443-67aab6c485b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:45.432070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b3dfa8d-3466-4f11-b443-67aab6c485b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:45.507893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8b3dfa8d-3466-4f11-b443-67aab6c485b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:45.515623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8b3dfa8d-3466-4f11-b443-67aab6c485b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.096402 May 26 13:09:45.516194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 600/1227] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:45 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:46.540893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e8bbff1-2bd5-4053-9167-010b82c551d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:46.541464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e8bbff1-2bd5-4053-9167-010b82c551d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:46.543964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:46.548769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e8bbff1-2bd5-4053-9167-010b82c551d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:46.549222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e8bbff1-2bd5-4053-9167-010b82c551d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:46.549993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e8bbff1-2bd5-4053-9167-010b82c551d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:46.550433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e8bbff1-2bd5-4053-9167-010b82c551d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:46.553634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:46.617042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e8bbff1-2bd5-4053-9167-010b82c551d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:46.624472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e8bbff1-2bd5-4053-9167-010b82c551d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088151 May 26 13:09:46.625035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 628/1228] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:46 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:47.641576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90a12345-6ee2-4566-989b-ee3d893d2433 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:47.642187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90a12345-6ee2-4566-989b-ee3d893d2433 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:47.644561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=31 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:47.649492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90a12345-6ee2-4566-989b-ee3d893d2433 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:47.649948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90a12345-6ee2-4566-989b-ee3d893d2433 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:47.650745 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90a12345-6ee2-4566-989b-ee3d893d2433 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:47.651178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90a12345-6ee2-4566-989b-ee3d893d2433 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:47.655201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=87 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:47.712796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90a12345-6ee2-4566-989b-ee3d893d2433 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:47.720223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90a12345-6ee2-4566-989b-ee3d893d2433 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082654 May 26 13:09:47.720930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 601/1229] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:47 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:48.741145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71d8e7f7-ce07-4693-a0a0-50b2e77c09e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:48.741781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-71d8e7f7-ce07-4693-a0a0-50b2e77c09e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:48.749292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71d8e7f7-ce07-4693-a0a0-50b2e77c09e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:48.749775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71d8e7f7-ce07-4693-a0a0-50b2e77c09e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:48.750548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71d8e7f7-ce07-4693-a0a0-50b2e77c09e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:48.750990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71d8e7f7-ce07-4693-a0a0-50b2e77c09e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:48.812259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-71d8e7f7-ce07-4693-a0a0-50b2e77c09e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:48.819845 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-71d8e7f7-ce07-4693-a0a0-50b2e77c09e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083971 May 26 13:09:48.820417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 629/1230] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:48 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:49.837627 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1fa101e1-cb4c-4566-a7e6-fe689c6f8587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:49.838234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1fa101e1-cb4c-4566-a7e6-fe689c6f8587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:49.845983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1fa101e1-cb4c-4566-a7e6-fe689c6f8587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:49.846434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1fa101e1-cb4c-4566-a7e6-fe689c6f8587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:49.847273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1fa101e1-cb4c-4566-a7e6-fe689c6f8587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:49.847844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1fa101e1-cb4c-4566-a7e6-fe689c6f8587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:49.916297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1fa101e1-cb4c-4566-a7e6-fe689c6f8587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:49.923933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1fa101e1-cb4c-4566-a7e6-fe689c6f8587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090819 May 26 13:09:49.924500 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 602/1231] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:49 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:50.940591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84dcf5e0-86d0-47ae-91cb-c9d4a35110e1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:50.941199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84dcf5e0-86d0-47ae-91cb-c9d4a35110e1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:50.948443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84dcf5e0-86d0-47ae-91cb-c9d4a35110e1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:50.948888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84dcf5e0-86d0-47ae-91cb-c9d4a35110e1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:50.949669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84dcf5e0-86d0-47ae-91cb-c9d4a35110e1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:50.950103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84dcf5e0-86d0-47ae-91cb-c9d4a35110e1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:51.014579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84dcf5e0-86d0-47ae-91cb-c9d4a35110e1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:51.023288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84dcf5e0-86d0-47ae-91cb-c9d4a35110e1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086556 May 26 13:09:51.023923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 630/1232] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:50 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:52.040724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e8d5775-e3f8-46a0-81c8-3f6da39aa076 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:52.041403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e8d5775-e3f8-46a0-81c8-3f6da39aa076 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:52.047917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e8d5775-e3f8-46a0-81c8-3f6da39aa076 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:52.048363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e8d5775-e3f8-46a0-81c8-3f6da39aa076 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:52.049128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e8d5775-e3f8-46a0-81c8-3f6da39aa076 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:52.049564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e8d5775-e3f8-46a0-81c8-3f6da39aa076 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:52.115632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1e8d5775-e3f8-46a0-81c8-3f6da39aa076 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:52.123600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e8d5775-e3f8-46a0-81c8-3f6da39aa076 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087593 May 26 13:09:52.127985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 603/1233] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:52 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:53.143060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1f9fe2c-7a79-484e-a795-782a9be515f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:53.143705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1f9fe2c-7a79-484e-a795-782a9be515f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:53.151078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1f9fe2c-7a79-484e-a795-782a9be515f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:53.151533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1f9fe2c-7a79-484e-a795-782a9be515f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:53.152308 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1f9fe2c-7a79-484e-a795-782a9be515f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:53.152753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1f9fe2c-7a79-484e-a795-782a9be515f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:53.213362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1f9fe2c-7a79-484e-a795-782a9be515f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:53.220959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1f9fe2c-7a79-484e-a795-782a9be515f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081715 May 26 13:09:53.221534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 631/1234] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:53 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:54.238436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7c0c2ef-6fbc-49ac-bc68-ba382b138825 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:54.239089 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7c0c2ef-6fbc-49ac-bc68-ba382b138825 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:54.245788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7c0c2ef-6fbc-49ac-bc68-ba382b138825 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:54.246251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7c0c2ef-6fbc-49ac-bc68-ba382b138825 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:54.247050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7c0c2ef-6fbc-49ac-bc68-ba382b138825 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:54.247495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7c0c2ef-6fbc-49ac-bc68-ba382b138825 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:54.311112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7c0c2ef-6fbc-49ac-bc68-ba382b138825 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:54.318964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7c0c2ef-6fbc-49ac-bc68-ba382b138825 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084681 May 26 13:09:54.319534 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 604/1235] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:54 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:55.335257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-059e2548-9fd4-41da-bf74-4837124f67c6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:55.335875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-059e2548-9fd4-41da-bf74-4837124f67c6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:55.342570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-059e2548-9fd4-41da-bf74-4837124f67c6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:55.343038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-059e2548-9fd4-41da-bf74-4837124f67c6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:55.343816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-059e2548-9fd4-41da-bf74-4837124f67c6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:55.344264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-059e2548-9fd4-41da-bf74-4837124f67c6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:55.409267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-059e2548-9fd4-41da-bf74-4837124f67c6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:55.417752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-059e2548-9fd4-41da-bf74-4837124f67c6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086481 May 26 13:09:55.418330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 632/1236] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:55 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:56.436458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-599e4239-bed6-43ab-a451-24739cb7f668 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:56.437138 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-599e4239-bed6-43ab-a451-24739cb7f668 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:56.445291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-599e4239-bed6-43ab-a451-24739cb7f668 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:56.445738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-599e4239-bed6-43ab-a451-24739cb7f668 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:56.446501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-599e4239-bed6-43ab-a451-24739cb7f668 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:56.446970 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-599e4239-bed6-43ab-a451-24739cb7f668 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:56.512560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-599e4239-bed6-43ab-a451-24739cb7f668 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:56.520488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-599e4239-bed6-43ab-a451-24739cb7f668 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088864 May 26 13:09:56.521046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 605/1237] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:56 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:57.538338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e3049861-baa5-421f-b097-b1a4d6172576 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:57.539072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e3049861-baa5-421f-b097-b1a4d6172576 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:57.545638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3049861-baa5-421f-b097-b1a4d6172576 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:57.546120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3049861-baa5-421f-b097-b1a4d6172576 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:57.546933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3049861-baa5-421f-b097-b1a4d6172576 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:57.547392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3049861-baa5-421f-b097-b1a4d6172576 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:57.612109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3049861-baa5-421f-b097-b1a4d6172576 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:57.620472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e3049861-baa5-421f-b097-b1a4d6172576 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087006 May 26 13:09:57.621041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 633/1238] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:57 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:58.637837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-de5fc693-bda4-445c-9787-b5cf841e510b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:58.638480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-de5fc693-bda4-445c-9787-b5cf841e510b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:58.645336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de5fc693-bda4-445c-9787-b5cf841e510b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:58.647915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de5fc693-bda4-445c-9787-b5cf841e510b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:58.647915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de5fc693-bda4-445c-9787-b5cf841e510b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:58.647915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de5fc693-bda4-445c-9787-b5cf841e510b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:58.711126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-de5fc693-bda4-445c-9787-b5cf841e510b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:58.718744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-de5fc693-bda4-445c-9787-b5cf841e510b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084934 May 26 13:09:58.719316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 606/1239] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:58 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:09:59.736763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e2e53e17-5283-4881-bef5-3da071d3d634 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:09:59.737619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e2e53e17-5283-4881-bef5-3da071d3d634 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:09:59.744410 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2e53e17-5283-4881-bef5-3da071d3d634 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:59.744868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2e53e17-5283-4881-bef5-3da071d3d634 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:59.745648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2e53e17-5283-4881-bef5-3da071d3d634 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:09:59.746093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2e53e17-5283-4881-bef5-3da071d3d634 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:09:59.813203 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e2e53e17-5283-4881-bef5-3da071d3d634 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:09:59.825177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e2e53e17-5283-4881-bef5-3da071d3d634 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092404 May 26 13:09:59.825764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 634/1240] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:09:59 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:00.842675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b28bf499-d819-49c9-ad6b-8d4889a9f09c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:00.843308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b28bf499-d819-49c9-ad6b-8d4889a9f09c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:00.850826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b28bf499-d819-49c9-ad6b-8d4889a9f09c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:00.851292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b28bf499-d819-49c9-ad6b-8d4889a9f09c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:00.852287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b28bf499-d819-49c9-ad6b-8d4889a9f09c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:00.852722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b28bf499-d819-49c9-ad6b-8d4889a9f09c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:00.925979 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b28bf499-d819-49c9-ad6b-8d4889a9f09c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:00.934257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b28bf499-d819-49c9-ad6b-8d4889a9f09c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.095672 May 26 13:10:00.934876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 607/1241] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:00 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:01.951578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-328b35b8-fc38-442d-bbd0-576aebd035a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:01.952185 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-328b35b8-fc38-442d-bbd0-576aebd035a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:01.960074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-328b35b8-fc38-442d-bbd0-576aebd035a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:01.960534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-328b35b8-fc38-442d-bbd0-576aebd035a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:01.961305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-328b35b8-fc38-442d-bbd0-576aebd035a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:01.961748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-328b35b8-fc38-442d-bbd0-576aebd035a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:02.024994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-328b35b8-fc38-442d-bbd0-576aebd035a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:02.032655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-328b35b8-fc38-442d-bbd0-576aebd035a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084953 May 26 13:10:02.033218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 635/1242] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:01 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:03.050614 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b527fbe5-5e2f-4ee1-ab24-00e1a9ade009 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:03.051252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b527fbe5-5e2f-4ee1-ab24-00e1a9ade009 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:03.058428 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b527fbe5-5e2f-4ee1-ab24-00e1a9ade009 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:03.058906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b527fbe5-5e2f-4ee1-ab24-00e1a9ade009 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:03.059663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b527fbe5-5e2f-4ee1-ab24-00e1a9ade009 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:03.060360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b527fbe5-5e2f-4ee1-ab24-00e1a9ade009 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:03.124606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b527fbe5-5e2f-4ee1-ab24-00e1a9ade009 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:03.134122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b527fbe5-5e2f-4ee1-ab24-00e1a9ade009 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087297 May 26 13:10:03.134771 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 608/1243] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:03 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:10:04.152538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-59111116-b956-434e-855e-237587ddef23 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:04.153144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-59111116-b956-434e-855e-237587ddef23 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:04.159668 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59111116-b956-434e-855e-237587ddef23 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:04.160177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59111116-b956-434e-855e-237587ddef23 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:04.160944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59111116-b956-434e-855e-237587ddef23 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:04.161493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59111116-b956-434e-855e-237587ddef23 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:04.227568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-59111116-b956-434e-855e-237587ddef23 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:04.235411 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-59111116-b956-434e-855e-237587ddef23 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086764 May 26 13:10:04.235977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 636/1244] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:04 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:05.252247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db200221-5421-40d1-98ba-6cde91ba5173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:05.252854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db200221-5421-40d1-98ba-6cde91ba5173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:05.260026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db200221-5421-40d1-98ba-6cde91ba5173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:05.260478 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db200221-5421-40d1-98ba-6cde91ba5173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:05.261250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db200221-5421-40d1-98ba-6cde91ba5173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:05.261684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db200221-5421-40d1-98ba-6cde91ba5173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:05.323194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db200221-5421-40d1-98ba-6cde91ba5173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:05.330629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db200221-5421-40d1-98ba-6cde91ba5173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082166 May 26 13:10:05.331194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 609/1245] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:05 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:06.348312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e3a17b4-83b5-4529-8830-82d00f1ca3f5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:06.349547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e3a17b4-83b5-4529-8830-82d00f1ca3f5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:06.356395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e3a17b4-83b5-4529-8830-82d00f1ca3f5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:06.356848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e3a17b4-83b5-4529-8830-82d00f1ca3f5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:06.357637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e3a17b4-83b5-4529-8830-82d00f1ca3f5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:06.358083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e3a17b4-83b5-4529-8830-82d00f1ca3f5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:06.421366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e3a17b4-83b5-4529-8830-82d00f1ca3f5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:06.429114 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e3a17b4-83b5-4529-8830-82d00f1ca3f5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084636 May 26 13:10:06.429696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 637/1246] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:06 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:07.445750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97cbe516-e3e0-4285-a8ee-86822e0f7824 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:07.446367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97cbe516-e3e0-4285-a8ee-86822e0f7824 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:07.452949 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97cbe516-e3e0-4285-a8ee-86822e0f7824 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:07.453409 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97cbe516-e3e0-4285-a8ee-86822e0f7824 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:07.454186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97cbe516-e3e0-4285-a8ee-86822e0f7824 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:07.454663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97cbe516-e3e0-4285-a8ee-86822e0f7824 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:07.516796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97cbe516-e3e0-4285-a8ee-86822e0f7824 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:07.525883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97cbe516-e3e0-4285-a8ee-86822e0f7824 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084544 May 26 13:10:07.526457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 610/1247] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:07 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:08.549274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e67a6da-83c0-4745-a65c-7b4676d96727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:08.551010 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e67a6da-83c0-4745-a65c-7b4676d96727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:08.557575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e67a6da-83c0-4745-a65c-7b4676d96727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:08.558139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e67a6da-83c0-4745-a65c-7b4676d96727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:08.558850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e67a6da-83c0-4745-a65c-7b4676d96727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:08.559296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e67a6da-83c0-4745-a65c-7b4676d96727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:08.622988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9e67a6da-83c0-4745-a65c-7b4676d96727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:08.632177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e67a6da-83c0-4745-a65c-7b4676d96727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085206 May 26 13:10:08.632177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 638/1248] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:08 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:09.647844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-acef6926-4f46-4cd8-8d60-8e72fc99f638 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:09.648452 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-acef6926-4f46-4cd8-8d60-8e72fc99f638 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:09.654911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acef6926-4f46-4cd8-8d60-8e72fc99f638 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:09.655364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acef6926-4f46-4cd8-8d60-8e72fc99f638 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:09.656123 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acef6926-4f46-4cd8-8d60-8e72fc99f638 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:09.656558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acef6926-4f46-4cd8-8d60-8e72fc99f638 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:09.721639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-acef6926-4f46-4cd8-8d60-8e72fc99f638 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:09.729682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-acef6926-4f46-4cd8-8d60-8e72fc99f638 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086319 May 26 13:10:09.730262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 611/1249] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:09 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:10.749172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4239285d-6c77-4cbb-9fe4-6e15c09d8b6b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:10.749933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4239285d-6c77-4cbb-9fe4-6e15c09d8b6b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:10.757819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4239285d-6c77-4cbb-9fe4-6e15c09d8b6b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:10.758430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4239285d-6c77-4cbb-9fe4-6e15c09d8b6b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:10.759256 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4239285d-6c77-4cbb-9fe4-6e15c09d8b6b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:10.759689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4239285d-6c77-4cbb-9fe4-6e15c09d8b6b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:10.822132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4239285d-6c77-4cbb-9fe4-6e15c09d8b6b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:10.829661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4239285d-6c77-4cbb-9fe4-6e15c09d8b6b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085805 May 26 13:10:10.830231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 639/1250] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:10 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:11.847376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0b84a52c-33b8-4b28-a323-6899c2120a72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:11.847943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b84a52c-33b8-4b28-a323-6899c2120a72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:11.855540 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b84a52c-33b8-4b28-a323-6899c2120a72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:11.855995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b84a52c-33b8-4b28-a323-6899c2120a72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:11.856777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b84a52c-33b8-4b28-a323-6899c2120a72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:11.857253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b84a52c-33b8-4b28-a323-6899c2120a72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:11.921632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b84a52c-33b8-4b28-a323-6899c2120a72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:11.929646 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0b84a52c-33b8-4b28-a323-6899c2120a72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086131 May 26 13:10:11.931233 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 612/1251] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:11 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:12.948156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8598e184-1285-4bcc-b62a-40a9853cd8d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:12.948742 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8598e184-1285-4bcc-b62a-40a9853cd8d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:12.955225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8598e184-1285-4bcc-b62a-40a9853cd8d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:12.955640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8598e184-1285-4bcc-b62a-40a9853cd8d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:12.956421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8598e184-1285-4bcc-b62a-40a9853cd8d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:12.956864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8598e184-1285-4bcc-b62a-40a9853cd8d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:13.029861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8598e184-1285-4bcc-b62a-40a9853cd8d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:13.037621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8598e184-1285-4bcc-b62a-40a9853cd8d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.094771 May 26 13:10:13.038192 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 640/1252] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:12 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:14.054331 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3aae526-a7d8-4e01-b22e-577da52de464 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:14.055213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3aae526-a7d8-4e01-b22e-577da52de464 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:14.063555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3aae526-a7d8-4e01-b22e-577da52de464 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:14.064010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3aae526-a7d8-4e01-b22e-577da52de464 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:14.064773 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3aae526-a7d8-4e01-b22e-577da52de464 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:14.065211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3aae526-a7d8-4e01-b22e-577da52de464 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:14.128102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3aae526-a7d8-4e01-b22e-577da52de464 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:14.137106 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3aae526-a7d8-4e01-b22e-577da52de464 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086570 May 26 13:10:14.137674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 613/1253] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:14 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:15.153373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2836172-3168-46fe-a818-e054ce8217b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:15.154252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2836172-3168-46fe-a818-e054ce8217b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:15.160961 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2836172-3168-46fe-a818-e054ce8217b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:15.161408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2836172-3168-46fe-a818-e054ce8217b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:15.162212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2836172-3168-46fe-a818-e054ce8217b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:15.162686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2836172-3168-46fe-a818-e054ce8217b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:15.225408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f2836172-3168-46fe-a818-e054ce8217b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:15.233658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2836172-3168-46fe-a818-e054ce8217b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084212 May 26 13:10:15.234232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 641/1254] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:15 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:16.251915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b346c1a-7fac-4252-8a12-cf5a7406b4ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:16.252524 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b346c1a-7fac-4252-8a12-cf5a7406b4ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:16.261506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b346c1a-7fac-4252-8a12-cf5a7406b4ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:16.261959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b346c1a-7fac-4252-8a12-cf5a7406b4ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:16.262784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b346c1a-7fac-4252-8a12-cf5a7406b4ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:16.263227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b346c1a-7fac-4252-8a12-cf5a7406b4ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:16.341788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b346c1a-7fac-4252-8a12-cf5a7406b4ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:16.351958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b346c1a-7fac-4252-8a12-cf5a7406b4ef tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.103654 May 26 13:10:16.352809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 614/1255] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:16 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:17.371876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b26ada4c-70b4-4e81-b55b-5413b337cc6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:17.376766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b26ada4c-70b4-4e81-b55b-5413b337cc6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:17.380077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b26ada4c-70b4-4e81-b55b-5413b337cc6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:17.380538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b26ada4c-70b4-4e81-b55b-5413b337cc6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:17.381326 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b26ada4c-70b4-4e81-b55b-5413b337cc6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:17.381770 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b26ada4c-70b4-4e81-b55b-5413b337cc6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:17.459959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b26ada4c-70b4-4e81-b55b-5413b337cc6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:17.468146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b26ada4c-70b4-4e81-b55b-5413b337cc6d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.101347 May 26 13:10:17.468723 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 642/1256] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:17 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:18.485668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52142ffa-69e7-41bb-b430-555d9500357a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:18.486284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52142ffa-69e7-41bb-b430-555d9500357a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:18.488869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:10:18.494420 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52142ffa-69e7-41bb-b430-555d9500357a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:18.494899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52142ffa-69e7-41bb-b430-555d9500357a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:18.495666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52142ffa-69e7-41bb-b430-555d9500357a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:18.496103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52142ffa-69e7-41bb-b430-555d9500357a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:18.563980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52142ffa-69e7-41bb-b430-555d9500357a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:18.572300 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52142ffa-69e7-41bb-b430-555d9500357a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090553 May 26 13:10:18.572847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 615/1257] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:18 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:19.590318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52ee9c60-96a0-4b86-bfa3-be5b42d0f344 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:19.591202 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52ee9c60-96a0-4b86-bfa3-be5b42d0f344 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:19.593796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=30 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:10:19.598797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ee9c60-96a0-4b86-bfa3-be5b42d0f344 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:19.599243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ee9c60-96a0-4b86-bfa3-be5b42d0f344 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:19.600014 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ee9c60-96a0-4b86-bfa3-be5b42d0f344 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:19.600446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ee9c60-96a0-4b86-bfa3-be5b42d0f344 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:19.603630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=90 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:10:19.667733 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52ee9c60-96a0-4b86-bfa3-be5b42d0f344 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:19.675996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52ee9c60-96a0-4b86-bfa3-be5b42d0f344 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090279 May 26 13:10:19.676558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 643/1258] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:19 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:20.693380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b903132-623b-4395-b302-72c162dfbf98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:20.694034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b903132-623b-4395-b302-72c162dfbf98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:20.700729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b903132-623b-4395-b302-72c162dfbf98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:20.701177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b903132-623b-4395-b302-72c162dfbf98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:20.701946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b903132-623b-4395-b302-72c162dfbf98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:20.702386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b903132-623b-4395-b302-72c162dfbf98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:20.705137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=90 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:10:20.765232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4b903132-623b-4395-b302-72c162dfbf98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:20.773749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b903132-623b-4395-b302-72c162dfbf98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083602 May 26 13:10:20.774585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 616/1259] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:20 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:21.791979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9df6c55-9acc-472f-96f6-1952cbc5844c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:21.792609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9df6c55-9acc-472f-96f6-1952cbc5844c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:21.802878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9df6c55-9acc-472f-96f6-1952cbc5844c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:21.803342 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9df6c55-9acc-472f-96f6-1952cbc5844c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:21.804161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9df6c55-9acc-472f-96f6-1952cbc5844c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:21.804610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9df6c55-9acc-472f-96f6-1952cbc5844c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:21.873790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9df6c55-9acc-472f-96f6-1952cbc5844c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:21.883632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9df6c55-9acc-472f-96f6-1952cbc5844c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.095811 May 26 13:10:21.884209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 644/1260] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:21 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:22.901555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f21d5551-2975-4062-9fbc-49c5e8486725 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:22.902171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f21d5551-2975-4062-9fbc-49c5e8486725 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:22.908823 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f21d5551-2975-4062-9fbc-49c5e8486725 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:22.909351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f21d5551-2975-4062-9fbc-49c5e8486725 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:22.910049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f21d5551-2975-4062-9fbc-49c5e8486725 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:22.910488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f21d5551-2975-4062-9fbc-49c5e8486725 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:22.972956 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f21d5551-2975-4062-9fbc-49c5e8486725 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:22.981901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f21d5551-2975-4062-9fbc-49c5e8486725 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085136 May 26 13:10:22.982485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 617/1261] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:22 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:24.001080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a8bb3daa-4a2e-4c11-bb7a-4c06efedebcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:24.001720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a8bb3daa-4a2e-4c11-bb7a-4c06efedebcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:24.008427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8bb3daa-4a2e-4c11-bb7a-4c06efedebcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:24.008826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8bb3daa-4a2e-4c11-bb7a-4c06efedebcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:24.009618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8bb3daa-4a2e-4c11-bb7a-4c06efedebcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:24.010077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8bb3daa-4a2e-4c11-bb7a-4c06efedebcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:24.075164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8bb3daa-4a2e-4c11-bb7a-4c06efedebcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:24.082760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a8bb3daa-4a2e-4c11-bb7a-4c06efedebcd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086530 May 26 13:10:24.083329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 645/1262] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:23 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:25.100562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f0fd6901-2bf7-446d-80a7-6e6f208c5084 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:25.101171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f0fd6901-2bf7-446d-80a7-6e6f208c5084 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:25.108493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0fd6901-2bf7-446d-80a7-6e6f208c5084 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:25.108954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0fd6901-2bf7-446d-80a7-6e6f208c5084 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:25.109737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0fd6901-2bf7-446d-80a7-6e6f208c5084 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:25.110178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0fd6901-2bf7-446d-80a7-6e6f208c5084 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:25.181232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f0fd6901-2bf7-446d-80a7-6e6f208c5084 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:25.189234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f0fd6901-2bf7-446d-80a7-6e6f208c5084 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092682 May 26 13:10:25.189969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 618/1263] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:25 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:26.208629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-acc95f24-aec1-4946-98f8-962ce31be9e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:26.209228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-acc95f24-aec1-4946-98f8-962ce31be9e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:26.217191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-acc95f24-aec1-4946-98f8-962ce31be9e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:26.217728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-acc95f24-aec1-4946-98f8-962ce31be9e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:26.218398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-acc95f24-aec1-4946-98f8-962ce31be9e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:26.218859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-acc95f24-aec1-4946-98f8-962ce31be9e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:26.289246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-acc95f24-aec1-4946-98f8-962ce31be9e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:26.297254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-acc95f24-aec1-4946-98f8-962ce31be9e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092391 May 26 13:10:26.297842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 646/1264] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:26 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:27.320636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-73896c7e-4b1c-4238-8384-03275ec3b7bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:27.321213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-73896c7e-4b1c-4238-8384-03275ec3b7bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:27.327767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73896c7e-4b1c-4238-8384-03275ec3b7bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:27.328308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73896c7e-4b1c-4238-8384-03275ec3b7bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:27.329081 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73896c7e-4b1c-4238-8384-03275ec3b7bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:27.329512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73896c7e-4b1c-4238-8384-03275ec3b7bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:27.403551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-73896c7e-4b1c-4238-8384-03275ec3b7bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:27.411604 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-73896c7e-4b1c-4238-8384-03275ec3b7bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.094899 May 26 13:10:27.412171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 619/1265] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:27 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:28.431033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be85eb83-1944-475e-bc43-aca79ca7f2ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:28.431658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be85eb83-1944-475e-bc43-aca79ca7f2ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:28.437747 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be85eb83-1944-475e-bc43-aca79ca7f2ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:28.438199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be85eb83-1944-475e-bc43-aca79ca7f2ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:28.439129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be85eb83-1944-475e-bc43-aca79ca7f2ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:28.439571 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be85eb83-1944-475e-bc43-aca79ca7f2ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:28.502231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be85eb83-1944-475e-bc43-aca79ca7f2ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:28.510733 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be85eb83-1944-475e-bc43-aca79ca7f2ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084372 May 26 13:10:28.517297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 647/1266] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:28 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:29.528716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2c226234-f2fa-419f-81c3-fc8511c9dcb7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:29.529328 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2c226234-f2fa-419f-81c3-fc8511c9dcb7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:29.536582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c226234-f2fa-419f-81c3-fc8511c9dcb7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:29.537037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c226234-f2fa-419f-81c3-fc8511c9dcb7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:29.537818 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c226234-f2fa-419f-81c3-fc8511c9dcb7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:29.538259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c226234-f2fa-419f-81c3-fc8511c9dcb7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:29.606348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2c226234-f2fa-419f-81c3-fc8511c9dcb7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:29.614332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2c226234-f2fa-419f-81c3-fc8511c9dcb7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089566 May 26 13:10:29.614931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 620/1267] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:29 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:10:30.631598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e57a3f02-ef75-4e6a-bf97-25d510ac08dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:30.632219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e57a3f02-ef75-4e6a-bf97-25d510ac08dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:30.639733 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e57a3f02-ef75-4e6a-bf97-25d510ac08dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:30.640263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e57a3f02-ef75-4e6a-bf97-25d510ac08dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:30.641039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e57a3f02-ef75-4e6a-bf97-25d510ac08dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:30.641486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e57a3f02-ef75-4e6a-bf97-25d510ac08dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:30.706314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e57a3f02-ef75-4e6a-bf97-25d510ac08dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:30.714892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e57a3f02-ef75-4e6a-bf97-25d510ac08dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087252 May 26 13:10:30.715460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 648/1268] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:30 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:31.732621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7dfad27f-d917-4f3c-8094-f16550bf224c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:31.733327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7dfad27f-d917-4f3c-8094-f16550bf224c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:31.740097 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dfad27f-d917-4f3c-8094-f16550bf224c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:31.740555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dfad27f-d917-4f3c-8094-f16550bf224c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:31.741351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dfad27f-d917-4f3c-8094-f16550bf224c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:31.741776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dfad27f-d917-4f3c-8094-f16550bf224c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:31.803223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7dfad27f-d917-4f3c-8094-f16550bf224c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:31.811247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7dfad27f-d917-4f3c-8094-f16550bf224c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082435 May 26 13:10:31.811825 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 621/1269] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:31 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:10:32.828901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a033180-003b-4007-8cc3-35d0cab2170e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:32.829641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a033180-003b-4007-8cc3-35d0cab2170e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:32.837369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a033180-003b-4007-8cc3-35d0cab2170e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:32.837832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a033180-003b-4007-8cc3-35d0cab2170e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:32.839141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a033180-003b-4007-8cc3-35d0cab2170e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:32.839815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a033180-003b-4007-8cc3-35d0cab2170e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:32.903157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a033180-003b-4007-8cc3-35d0cab2170e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:32.910587 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a033180-003b-4007-8cc3-35d0cab2170e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085631 May 26 13:10:32.911321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 649/1270] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:32 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:33.927658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2ef6759c-3bf0-4a8d-9f35-d56e3ccd5d98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:33.928274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2ef6759c-3bf0-4a8d-9f35-d56e3ccd5d98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:33.935471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ef6759c-3bf0-4a8d-9f35-d56e3ccd5d98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:33.935921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ef6759c-3bf0-4a8d-9f35-d56e3ccd5d98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:33.936746 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ef6759c-3bf0-4a8d-9f35-d56e3ccd5d98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:33.937185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ef6759c-3bf0-4a8d-9f35-d56e3ccd5d98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:34.000030 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2ef6759c-3bf0-4a8d-9f35-d56e3ccd5d98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:34.007971 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2ef6759c-3bf0-4a8d-9f35-d56e3ccd5d98 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083728 May 26 13:10:34.008187 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 622/1271] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:33 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:35.024578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87b6d06f-7635-4b2d-99e7-a699f1ef50ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:35.025172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87b6d06f-7635-4b2d-99e7-a699f1ef50ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:35.031670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87b6d06f-7635-4b2d-99e7-a699f1ef50ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:35.032119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87b6d06f-7635-4b2d-99e7-a699f1ef50ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:35.032882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87b6d06f-7635-4b2d-99e7-a699f1ef50ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:35.033316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87b6d06f-7635-4b2d-99e7-a699f1ef50ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:35.096831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-87b6d06f-7635-4b2d-99e7-a699f1ef50ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:35.101027 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87b6d06f-7635-4b2d-99e7-a699f1ef50ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.080336 May 26 13:10:35.101590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 650/1272] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:35 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:36.118079 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef721e3a-7db8-4f24-8d55-0a586d5564c3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:36.118701 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef721e3a-7db8-4f24-8d55-0a586d5564c3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:36.125844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef721e3a-7db8-4f24-8d55-0a586d5564c3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:36.126290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef721e3a-7db8-4f24-8d55-0a586d5564c3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:36.127074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef721e3a-7db8-4f24-8d55-0a586d5564c3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:36.127510 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef721e3a-7db8-4f24-8d55-0a586d5564c3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:36.190375 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ef721e3a-7db8-4f24-8d55-0a586d5564c3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:36.197833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef721e3a-7db8-4f24-8d55-0a586d5564c3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083591 May 26 13:10:36.198629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 623/1273] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:36 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:37.214937 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c4e073fa-fb2b-412c-ad51-1c731cd00f40 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:37.215563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4e073fa-fb2b-412c-ad51-1c731cd00f40 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:37.222745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4e073fa-fb2b-412c-ad51-1c731cd00f40 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:37.223196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4e073fa-fb2b-412c-ad51-1c731cd00f40 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:37.223965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4e073fa-fb2b-412c-ad51-1c731cd00f40 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:37.224400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4e073fa-fb2b-412c-ad51-1c731cd00f40 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:37.295041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4e073fa-fb2b-412c-ad51-1c731cd00f40 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:37.305285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c4e073fa-fb2b-412c-ad51-1c731cd00f40 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.094230 May 26 13:10:37.305882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 651/1274] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:37 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:38.324518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b9c056e-cfa5-4846-a854-1240aab1d465 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:38.325139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b9c056e-cfa5-4846-a854-1240aab1d465 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:38.331704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b9c056e-cfa5-4846-a854-1240aab1d465 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:38.332195 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b9c056e-cfa5-4846-a854-1240aab1d465 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:38.332961 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b9c056e-cfa5-4846-a854-1240aab1d465 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:38.333404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b9c056e-cfa5-4846-a854-1240aab1d465 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:38.396287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b9c056e-cfa5-4846-a854-1240aab1d465 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:38.404341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b9c056e-cfa5-4846-a854-1240aab1d465 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084485 May 26 13:10:38.404936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 624/1275] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:38 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:39.421939 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc98e50a-a566-4fb7-a068-6624d91343b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:39.422561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc98e50a-a566-4fb7-a068-6624d91343b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:39.429235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc98e50a-a566-4fb7-a068-6624d91343b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:39.429693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc98e50a-a566-4fb7-a068-6624d91343b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:39.430509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc98e50a-a566-4fb7-a068-6624d91343b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:39.430969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc98e50a-a566-4fb7-a068-6624d91343b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:39.496703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc98e50a-a566-4fb7-a068-6624d91343b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:39.504225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc98e50a-a566-4fb7-a068-6624d91343b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086341 May 26 13:10:39.504797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 652/1276] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:39 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:40.521951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d08c219c-0318-458e-8783-dd227753918f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:40.522684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d08c219c-0318-458e-8783-dd227753918f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:40.529808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d08c219c-0318-458e-8783-dd227753918f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:40.530262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d08c219c-0318-458e-8783-dd227753918f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:40.531070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d08c219c-0318-458e-8783-dd227753918f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:40.531560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d08c219c-0318-458e-8783-dd227753918f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:40.591860 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d08c219c-0318-458e-8783-dd227753918f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:40.599552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d08c219c-0318-458e-8783-dd227753918f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081418 May 26 13:10:40.604462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 625/1277] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:40 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:41.616668 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cd55a507-f7b2-4de5-bd6f-23a0a8b705f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:41.617277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cd55a507-f7b2-4de5-bd6f-23a0a8b705f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:41.623919 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd55a507-f7b2-4de5-bd6f-23a0a8b705f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:41.624366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd55a507-f7b2-4de5-bd6f-23a0a8b705f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:41.625161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd55a507-f7b2-4de5-bd6f-23a0a8b705f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:41.625596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd55a507-f7b2-4de5-bd6f-23a0a8b705f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:41.691706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cd55a507-f7b2-4de5-bd6f-23a0a8b705f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:41.696542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cd55a507-f7b2-4de5-bd6f-23a0a8b705f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083699 May 26 13:10:41.697101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 653/1278] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:41 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:42.713639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dad4f5fc-d395-4182-810c-a41ea08d009f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:42.714253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dad4f5fc-d395-4182-810c-a41ea08d009f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:42.720840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad4f5fc-d395-4182-810c-a41ea08d009f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:42.721292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad4f5fc-d395-4182-810c-a41ea08d009f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:42.722067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad4f5fc-d395-4182-810c-a41ea08d009f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:42.722505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad4f5fc-d395-4182-810c-a41ea08d009f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:42.784388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dad4f5fc-d395-4182-810c-a41ea08d009f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:42.792365 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dad4f5fc-d395-4182-810c-a41ea08d009f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082196 May 26 13:10:42.792922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 626/1279] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:42 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:10:43.810129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10370727-9465-41d4-84ae-8c44290c975c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:43.810888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10370727-9465-41d4-84ae-8c44290c975c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:43.817500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10370727-9465-41d4-84ae-8c44290c975c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:43.817951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10370727-9465-41d4-84ae-8c44290c975c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:43.818748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10370727-9465-41d4-84ae-8c44290c975c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:43.819189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10370727-9465-41d4-84ae-8c44290c975c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:43.885010 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10370727-9465-41d4-84ae-8c44290c975c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:43.889763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10370727-9465-41d4-84ae-8c44290c975c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084496 May 26 13:10:43.890327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 654/1280] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:43 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:44.907367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aa0c002e-6102-4ca0-ad0f-b746b8233fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:44.908012 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aa0c002e-6102-4ca0-ad0f-b746b8233fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:44.914671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa0c002e-6102-4ca0-ad0f-b746b8233fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:44.915129 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa0c002e-6102-4ca0-ad0f-b746b8233fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:44.915894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa0c002e-6102-4ca0-ad0f-b746b8233fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:44.916363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa0c002e-6102-4ca0-ad0f-b746b8233fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:44.981969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aa0c002e-6102-4ca0-ad0f-b746b8233fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:44.989914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aa0c002e-6102-4ca0-ad0f-b746b8233fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086349 May 26 13:10:44.990493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 627/1281] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:44 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:46.006886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6c47af0-0a0b-416f-b834-336085b3191e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:46.007508 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6c47af0-0a0b-416f-b834-336085b3191e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:46.013431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6c47af0-0a0b-416f-b834-336085b3191e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:46.013880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6c47af0-0a0b-416f-b834-336085b3191e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:46.014673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6c47af0-0a0b-416f-b834-336085b3191e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:46.015110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6c47af0-0a0b-416f-b834-336085b3191e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:46.075374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6c47af0-0a0b-416f-b834-336085b3191e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:46.082795 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6c47af0-0a0b-416f-b834-336085b3191e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.080234 May 26 13:10:46.083356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 655/1282] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:46 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:47.100870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6c8501c4-0f84-4330-9915-c97d2319399e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:47.101490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6c8501c4-0f84-4330-9915-c97d2319399e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:47.109068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c8501c4-0f84-4330-9915-c97d2319399e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:47.109523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c8501c4-0f84-4330-9915-c97d2319399e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:47.110288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c8501c4-0f84-4330-9915-c97d2319399e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:47.110765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c8501c4-0f84-4330-9915-c97d2319399e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:47.172845 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6c8501c4-0f84-4330-9915-c97d2319399e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:47.180430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6c8501c4-0f84-4330-9915-c97d2319399e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083388 May 26 13:10:47.180988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 628/1283] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:47 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:48.199093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-46069607-01a4-4792-8a4b-4c804e10849f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:48.199756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-46069607-01a4-4792-8a4b-4c804e10849f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:48.206362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46069607-01a4-4792-8a4b-4c804e10849f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:48.206887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46069607-01a4-4792-8a4b-4c804e10849f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:48.207684 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46069607-01a4-4792-8a4b-4c804e10849f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:48.208132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46069607-01a4-4792-8a4b-4c804e10849f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:48.272631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-46069607-01a4-4792-8a4b-4c804e10849f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:48.280786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-46069607-01a4-4792-8a4b-4c804e10849f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085638 May 26 13:10:48.281588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 656/1284] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:48 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:49.298229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90663677-f8b2-4a44-a091-fb47ccfdb5c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:49.298858 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90663677-f8b2-4a44-a091-fb47ccfdb5c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:49.301238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:10:49.306031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90663677-f8b2-4a44-a091-fb47ccfdb5c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:49.306487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90663677-f8b2-4a44-a091-fb47ccfdb5c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:49.307995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90663677-f8b2-4a44-a091-fb47ccfdb5c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:49.308484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90663677-f8b2-4a44-a091-fb47ccfdb5c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:49.371887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90663677-f8b2-4a44-a091-fb47ccfdb5c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:49.379758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90663677-f8b2-4a44-a091-fb47ccfdb5c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085428 May 26 13:10:49.380324 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 629/1285] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:49 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:50.396416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4cb5dd13-c628-414e-9467-8b30707c0ba5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:50.397018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4cb5dd13-c628-414e-9467-8b30707c0ba5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:50.399401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:10:50.405598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cb5dd13-c628-414e-9467-8b30707c0ba5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:50.406168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cb5dd13-c628-414e-9467-8b30707c0ba5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:50.407006 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cb5dd13-c628-414e-9467-8b30707c0ba5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:50.407436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cb5dd13-c628-414e-9467-8b30707c0ba5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:50.410222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:10:50.475307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4cb5dd13-c628-414e-9467-8b30707c0ba5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:50.483627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4cb5dd13-c628-414e-9467-8b30707c0ba5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091208 May 26 13:10:50.484197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 657/1286] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:50 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:51.501888 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-df5b4854-fb98-40f4-be8a-3fcde4e85ab7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:51.502506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-df5b4854-fb98-40f4-be8a-3fcde4e85ab7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:51.509681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df5b4854-fb98-40f4-be8a-3fcde4e85ab7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:51.510985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df5b4854-fb98-40f4-be8a-3fcde4e85ab7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:51.511799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df5b4854-fb98-40f4-be8a-3fcde4e85ab7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:51.512240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df5b4854-fb98-40f4-be8a-3fcde4e85ab7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:51.515162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:10:51.575215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-df5b4854-fb98-40f4-be8a-3fcde4e85ab7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:51.582618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-df5b4854-fb98-40f4-be8a-3fcde4e85ab7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085786 May 26 13:10:51.583178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 630/1287] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:51 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:52.600191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a8bbdde4-ce85-4b13-88d3-5f169be09bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:52.600753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a8bbdde4-ce85-4b13-88d3-5f169be09bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:52.608198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8bbdde4-ce85-4b13-88d3-5f169be09bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:52.608640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8bbdde4-ce85-4b13-88d3-5f169be09bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:52.609417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8bbdde4-ce85-4b13-88d3-5f169be09bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:52.609854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8bbdde4-ce85-4b13-88d3-5f169be09bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:52.675960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8bbdde4-ce85-4b13-88d3-5f169be09bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:52.684196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a8bbdde4-ce85-4b13-88d3-5f169be09bfe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087951 May 26 13:10:52.684971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 658/1288] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:52 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:53.701837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-effee6f0-48c0-4946-81fa-ceaae56290b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:53.702449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-effee6f0-48c0-4946-81fa-ceaae56290b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:53.709014 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-effee6f0-48c0-4946-81fa-ceaae56290b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:53.709497 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-effee6f0-48c0-4946-81fa-ceaae56290b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:53.710322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-effee6f0-48c0-4946-81fa-ceaae56290b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:53.710791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-effee6f0-48c0-4946-81fa-ceaae56290b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:53.775724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-effee6f0-48c0-4946-81fa-ceaae56290b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:53.783541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-effee6f0-48c0-4946-81fa-ceaae56290b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086468 May 26 13:10:53.784106 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 631/1289] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:53 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:54.800763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68940de4-5492-4040-97e4-4d5bc7c10221 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:54.801386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68940de4-5492-4040-97e4-4d5bc7c10221 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:54.808385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68940de4-5492-4040-97e4-4d5bc7c10221 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:54.808838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68940de4-5492-4040-97e4-4d5bc7c10221 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:54.809612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68940de4-5492-4040-97e4-4d5bc7c10221 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:54.810049 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68940de4-5492-4040-97e4-4d5bc7c10221 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:54.873043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68940de4-5492-4040-97e4-4d5bc7c10221 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:54.880577 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68940de4-5492-4040-97e4-4d5bc7c10221 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083616 May 26 13:10:54.881174 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 659/1290] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:54 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:55.898573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5aa15f09-859a-41ab-94d0-29331e32117a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:55.899444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5aa15f09-859a-41ab-94d0-29331e32117a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:55.906570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aa15f09-859a-41ab-94d0-29331e32117a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:55.907036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aa15f09-859a-41ab-94d0-29331e32117a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:55.907814 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aa15f09-859a-41ab-94d0-29331e32117a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:55.908260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aa15f09-859a-41ab-94d0-29331e32117a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:55.969426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5aa15f09-859a-41ab-94d0-29331e32117a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:55.977048 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5aa15f09-859a-41ab-94d0-29331e32117a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082332 May 26 13:10:55.977628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 632/1291] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:55 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:56.995743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ded7e8b9-7289-4507-be9b-353c1008e12d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:56.996373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ded7e8b9-7289-4507-be9b-353c1008e12d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:57.003366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded7e8b9-7289-4507-be9b-353c1008e12d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:57.003815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded7e8b9-7289-4507-be9b-353c1008e12d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:57.004588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded7e8b9-7289-4507-be9b-353c1008e12d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:57.005020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded7e8b9-7289-4507-be9b-353c1008e12d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:57.073575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ded7e8b9-7289-4507-be9b-353c1008e12d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:57.081371 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ded7e8b9-7289-4507-be9b-353c1008e12d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090473 May 26 13:10:57.081958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 660/1292] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:56 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:58.097679 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64e7d971-df97-4690-8d16-1ef12b808d10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:58.098405 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64e7d971-df97-4690-8d16-1ef12b808d10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:58.105775 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64e7d971-df97-4690-8d16-1ef12b808d10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:58.106263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64e7d971-df97-4690-8d16-1ef12b808d10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:58.107108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64e7d971-df97-4690-8d16-1ef12b808d10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:58.107555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64e7d971-df97-4690-8d16-1ef12b808d10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:58.177227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64e7d971-df97-4690-8d16-1ef12b808d10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:58.186772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64e7d971-df97-4690-8d16-1ef12b808d10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.093071 May 26 13:10:58.187663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 633/1293] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:58 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:10:59.206176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d0a60ff5-62f2-478b-8176-3f51970fc884 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:10:59.206812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d0a60ff5-62f2-478b-8176-3f51970fc884 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:10:59.213063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0a60ff5-62f2-478b-8176-3f51970fc884 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:59.213517 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0a60ff5-62f2-478b-8176-3f51970fc884 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:59.214289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0a60ff5-62f2-478b-8176-3f51970fc884 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:10:59.214751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0a60ff5-62f2-478b-8176-3f51970fc884 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:10:59.277774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0a60ff5-62f2-478b-8176-3f51970fc884 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:10:59.285401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d0a60ff5-62f2-478b-8176-3f51970fc884 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083187 May 26 13:10:59.285976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 661/1294] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:10:59 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:00.303261 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cee4e829-94d0-4aad-a134-6376a6646a16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:00.303990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cee4e829-94d0-4aad-a134-6376a6646a16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:00.311303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cee4e829-94d0-4aad-a134-6376a6646a16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:00.311761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cee4e829-94d0-4aad-a134-6376a6646a16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:00.312547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cee4e829-94d0-4aad-a134-6376a6646a16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:00.312995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cee4e829-94d0-4aad-a134-6376a6646a16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:00.379766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cee4e829-94d0-4aad-a134-6376a6646a16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:00.388064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cee4e829-94d0-4aad-a134-6376a6646a16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088731 May 26 13:11:00.388638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 634/1295] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:00 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:01.405136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ad5dd45-946c-462e-a237-04098c1c5771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:01.405773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ad5dd45-946c-462e-a237-04098c1c5771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:01.412494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ad5dd45-946c-462e-a237-04098c1c5771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:01.412943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ad5dd45-946c-462e-a237-04098c1c5771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:01.416618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ad5dd45-946c-462e-a237-04098c1c5771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:01.416618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ad5dd45-946c-462e-a237-04098c1c5771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:01.478707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0ad5dd45-946c-462e-a237-04098c1c5771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:01.486505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ad5dd45-946c-462e-a237-04098c1c5771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085787 May 26 13:11:01.487102 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 662/1296] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:01 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:02.503652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-490cef4c-6a6b-467d-9890-5dff1b1fe024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:02.504281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-490cef4c-6a6b-467d-9890-5dff1b1fe024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:02.511082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-490cef4c-6a6b-467d-9890-5dff1b1fe024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:02.511529 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-490cef4c-6a6b-467d-9890-5dff1b1fe024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:02.512310 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-490cef4c-6a6b-467d-9890-5dff1b1fe024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:02.512746 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-490cef4c-6a6b-467d-9890-5dff1b1fe024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:02.580815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-490cef4c-6a6b-467d-9890-5dff1b1fe024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:02.590026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-490cef4c-6a6b-467d-9890-5dff1b1fe024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090190 May 26 13:11:02.590618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 635/1297] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:02 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:03.608462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7680cd55-17a2-4167-a942-35b73f143746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:03.609058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7680cd55-17a2-4167-a942-35b73f143746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:03.617865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7680cd55-17a2-4167-a942-35b73f143746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:03.618546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7680cd55-17a2-4167-a942-35b73f143746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:03.619781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7680cd55-17a2-4167-a942-35b73f143746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:03.620373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7680cd55-17a2-4167-a942-35b73f143746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:03.686889 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7680cd55-17a2-4167-a942-35b73f143746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:03.694691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7680cd55-17a2-4167-a942-35b73f143746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089987 May 26 13:11:03.695302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 663/1298] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:03 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:04.713092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3cb23ec-49ef-4226-b34d-e00f3cfd4e3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:04.714280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3cb23ec-49ef-4226-b34d-e00f3cfd4e3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:04.721088 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3cb23ec-49ef-4226-b34d-e00f3cfd4e3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:04.721541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3cb23ec-49ef-4226-b34d-e00f3cfd4e3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:04.722311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3cb23ec-49ef-4226-b34d-e00f3cfd4e3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:04.722779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3cb23ec-49ef-4226-b34d-e00f3cfd4e3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:04.785051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b3cb23ec-49ef-4226-b34d-e00f3cfd4e3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:04.793860 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3cb23ec-49ef-4226-b34d-e00f3cfd4e3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085111 May 26 13:11:04.794426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 636/1299] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:04 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:05.810801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0dc530eb-396b-4b34-85ef-3a325302d4a8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:05.811381 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0dc530eb-396b-4b34-85ef-3a325302d4a8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:05.818153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dc530eb-396b-4b34-85ef-3a325302d4a8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:05.818626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dc530eb-396b-4b34-85ef-3a325302d4a8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:05.819392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dc530eb-396b-4b34-85ef-3a325302d4a8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:05.819827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dc530eb-396b-4b34-85ef-3a325302d4a8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:05.885377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0dc530eb-396b-4b34-85ef-3a325302d4a8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:05.893305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0dc530eb-396b-4b34-85ef-3a325302d4a8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086562 May 26 13:11:05.893879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 664/1300] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:05 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:06.912090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b77f7e72-4c42-432d-8c2d-393d82e829e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:06.912750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b77f7e72-4c42-432d-8c2d-393d82e829e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:06.922363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b77f7e72-4c42-432d-8c2d-393d82e829e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:06.922835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b77f7e72-4c42-432d-8c2d-393d82e829e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:06.923710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b77f7e72-4c42-432d-8c2d-393d82e829e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:06.924146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b77f7e72-4c42-432d-8c2d-393d82e829e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:06.985545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b77f7e72-4c42-432d-8c2d-393d82e829e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:06.993080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b77f7e72-4c42-432d-8c2d-393d82e829e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085121 May 26 13:11:06.993640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 637/1301] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:06 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:08.010393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f57cf974-480b-441d-b969-e9512484495f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:08.011218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f57cf974-480b-441d-b969-e9512484495f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:08.017773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f57cf974-480b-441d-b969-e9512484495f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:08.018219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f57cf974-480b-441d-b969-e9512484495f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:08.019018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f57cf974-480b-441d-b969-e9512484495f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:08.019457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f57cf974-480b-441d-b969-e9512484495f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:08.080439 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f57cf974-480b-441d-b969-e9512484495f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:08.088059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f57cf974-480b-441d-b969-e9512484495f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082266 May 26 13:11:08.088629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 665/1302] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:08 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:09.105035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2add4da-e2b0-46dc-b0e4-8b09e2056196 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:09.105682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2add4da-e2b0-46dc-b0e4-8b09e2056196 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:09.112519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2add4da-e2b0-46dc-b0e4-8b09e2056196 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:09.112997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2add4da-e2b0-46dc-b0e4-8b09e2056196 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:09.113761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2add4da-e2b0-46dc-b0e4-8b09e2056196 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:09.114204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2add4da-e2b0-46dc-b0e4-8b09e2056196 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:09.176774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2add4da-e2b0-46dc-b0e4-8b09e2056196 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:09.185219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2add4da-e2b0-46dc-b0e4-8b09e2056196 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084262 May 26 13:11:09.185793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 638/1303] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:09 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:10.207118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff760d75-b0b3-40ed-9bfc-700f18d31161 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:10.207755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff760d75-b0b3-40ed-9bfc-700f18d31161 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:10.214826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff760d75-b0b3-40ed-9bfc-700f18d31161 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:10.215275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff760d75-b0b3-40ed-9bfc-700f18d31161 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:10.216050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff760d75-b0b3-40ed-9bfc-700f18d31161 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:10.216486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff760d75-b0b3-40ed-9bfc-700f18d31161 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:10.285830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff760d75-b0b3-40ed-9bfc-700f18d31161 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:10.293896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff760d75-b0b3-40ed-9bfc-700f18d31161 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090655 May 26 13:11:10.294460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 666/1304] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:10 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:11.311563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1bb2a00-3c0a-4e8e-9933-98bf74853d3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:11.312218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1bb2a00-3c0a-4e8e-9933-98bf74853d3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:11.318838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1bb2a00-3c0a-4e8e-9933-98bf74853d3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:11.319288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1bb2a00-3c0a-4e8e-9933-98bf74853d3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:11.320085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1bb2a00-3c0a-4e8e-9933-98bf74853d3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:11.320519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1bb2a00-3c0a-4e8e-9933-98bf74853d3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:11.387841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1bb2a00-3c0a-4e8e-9933-98bf74853d3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:11.395683 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1bb2a00-3c0a-4e8e-9933-98bf74853d3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088899 May 26 13:11:11.396197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 639/1305] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:11 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:12.419294 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1b8192e-cc20-4e0b-8f46-f8499a8c3e99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:12.419916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1b8192e-cc20-4e0b-8f46-f8499a8c3e99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:12.426606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1b8192e-cc20-4e0b-8f46-f8499a8c3e99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:12.427209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1b8192e-cc20-4e0b-8f46-f8499a8c3e99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:12.427879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1b8192e-cc20-4e0b-8f46-f8499a8c3e99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:12.428323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1b8192e-cc20-4e0b-8f46-f8499a8c3e99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:12.492464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1b8192e-cc20-4e0b-8f46-f8499a8c3e99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:12.500156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1b8192e-cc20-4e0b-8f46-f8499a8c3e99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087584 May 26 13:11:12.500737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 667/1306] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:12 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:13.518028 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8b4dbf91-326c-4899-89a7-f5cc4a6c8e89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:13.518821 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8b4dbf91-326c-4899-89a7-f5cc4a6c8e89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:13.525180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b4dbf91-326c-4899-89a7-f5cc4a6c8e89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:13.525626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b4dbf91-326c-4899-89a7-f5cc4a6c8e89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:13.527004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b4dbf91-326c-4899-89a7-f5cc4a6c8e89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:13.527582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b4dbf91-326c-4899-89a7-f5cc4a6c8e89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:13.590328 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8b4dbf91-326c-4899-89a7-f5cc4a6c8e89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:13.597966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8b4dbf91-326c-4899-89a7-f5cc4a6c8e89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083846 May 26 13:11:13.599817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 640/1307] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:13 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:14.615801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d3e126c-24cc-4ad2-a541-be7c7f600d72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:14.616376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6d3e126c-24cc-4ad2-a541-be7c7f600d72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:14.623775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d3e126c-24cc-4ad2-a541-be7c7f600d72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:14.624238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d3e126c-24cc-4ad2-a541-be7c7f600d72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:14.625014 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d3e126c-24cc-4ad2-a541-be7c7f600d72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:14.625458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d3e126c-24cc-4ad2-a541-be7c7f600d72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:14.691013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d3e126c-24cc-4ad2-a541-be7c7f600d72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:14.699109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6d3e126c-24cc-4ad2-a541-be7c7f600d72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087181 May 26 13:11:14.699686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 668/1308] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:14 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:15.716690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e840581e-1c57-43f5-b430-0aa9a16a1e76 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:15.717319 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e840581e-1c57-43f5-b430-0aa9a16a1e76 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:15.723928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e840581e-1c57-43f5-b430-0aa9a16a1e76 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:15.724381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e840581e-1c57-43f5-b430-0aa9a16a1e76 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:15.725157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e840581e-1c57-43f5-b430-0aa9a16a1e76 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:15.725601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e840581e-1c57-43f5-b430-0aa9a16a1e76 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:15.790643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e840581e-1c57-43f5-b430-0aa9a16a1e76 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:15.800016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e840581e-1c57-43f5-b430-0aa9a16a1e76 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087814 May 26 13:11:15.800593 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 641/1309] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:15 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:16.817411 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f66c25c6-46b0-4362-a67b-17e785c52292 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:16.818015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f66c25c6-46b0-4362-a67b-17e785c52292 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:16.824709 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f66c25c6-46b0-4362-a67b-17e785c52292 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:16.825378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f66c25c6-46b0-4362-a67b-17e785c52292 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:16.825943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f66c25c6-46b0-4362-a67b-17e785c52292 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:16.826384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f66c25c6-46b0-4362-a67b-17e785c52292 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:16.893222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f66c25c6-46b0-4362-a67b-17e785c52292 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:16.900786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f66c25c6-46b0-4362-a67b-17e785c52292 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087223 May 26 13:11:16.902085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 669/1310] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:16 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:17.919315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b553d475-a5d9-45af-a6df-5c0de9e5bfc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:17.919931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b553d475-a5d9-45af-a6df-5c0de9e5bfc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:17.926559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b553d475-a5d9-45af-a6df-5c0de9e5bfc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:17.927027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b553d475-a5d9-45af-a6df-5c0de9e5bfc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:17.927797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b553d475-a5d9-45af-a6df-5c0de9e5bfc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:17.928238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b553d475-a5d9-45af-a6df-5c0de9e5bfc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:17.990655 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b553d475-a5d9-45af-a6df-5c0de9e5bfc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:17.998865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b553d475-a5d9-45af-a6df-5c0de9e5bfc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084406 May 26 13:11:18.000412 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 642/1311] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:17 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:11:19.023400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bde29921-d6e1-40fb-9c23-21c9be113acb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:19.024417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bde29921-d6e1-40fb-9c23-21c9be113acb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:19.032880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bde29921-d6e1-40fb-9c23-21c9be113acb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:19.033330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bde29921-d6e1-40fb-9c23-21c9be113acb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:19.034097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bde29921-d6e1-40fb-9c23-21c9be113acb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:19.034557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bde29921-d6e1-40fb-9c23-21c9be113acb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:19.097822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bde29921-d6e1-40fb-9c23-21c9be113acb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:19.105621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bde29921-d6e1-40fb-9c23-21c9be113acb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088940 May 26 13:11:19.106187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 670/1312] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:19 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:20.122726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-413c19a5-c4ca-4f06-a547-6e6a293c102f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:20.123342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-413c19a5-c4ca-4f06-a547-6e6a293c102f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:20.130078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-413c19a5-c4ca-4f06-a547-6e6a293c102f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:20.130550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-413c19a5-c4ca-4f06-a547-6e6a293c102f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:20.131364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-413c19a5-c4ca-4f06-a547-6e6a293c102f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:20.131811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-413c19a5-c4ca-4f06-a547-6e6a293c102f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:20.196321 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-413c19a5-c4ca-4f06-a547-6e6a293c102f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:20.204785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-413c19a5-c4ca-4f06-a547-6e6a293c102f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086245 May 26 13:11:20.205351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 643/1313] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:20 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:21.222580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c9689bf-954c-4d0d-b5dc-4a7c51771ed4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:21.223253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c9689bf-954c-4d0d-b5dc-4a7c51771ed4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:21.225576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:21.230561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c9689bf-954c-4d0d-b5dc-4a7c51771ed4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:21.231016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c9689bf-954c-4d0d-b5dc-4a7c51771ed4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:21.231792 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c9689bf-954c-4d0d-b5dc-4a7c51771ed4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:21.232227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c9689bf-954c-4d0d-b5dc-4a7c51771ed4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:21.234878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:21.297787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c9689bf-954c-4d0d-b5dc-4a7c51771ed4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:21.309791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c9689bf-954c-4d0d-b5dc-4a7c51771ed4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091036 May 26 13:11:21.310626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 671/1314] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:21 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:22.327246 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4db86fd1-60b7-403a-bc93-5202143d6c03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:22.327841 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4db86fd1-60b7-403a-bc93-5202143d6c03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:22.330181 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=30 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:22.334978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db86fd1-60b7-403a-bc93-5202143d6c03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:22.335427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db86fd1-60b7-403a-bc93-5202143d6c03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:22.336194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db86fd1-60b7-403a-bc93-5202143d6c03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:22.336626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db86fd1-60b7-403a-bc93-5202143d6c03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:22.339365 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:22.411981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4db86fd1-60b7-403a-bc93-5202143d6c03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:22.420042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4db86fd1-60b7-403a-bc93-5202143d6c03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.096747 May 26 13:11:22.420585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 644/1315] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:22 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:23.437060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-946acf9b-23a0-4476-a5e1-348530a924e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:23.437676 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-946acf9b-23a0-4476-a5e1-348530a924e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:23.444294 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-946acf9b-23a0-4476-a5e1-348530a924e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:23.444753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-946acf9b-23a0-4476-a5e1-348530a924e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:23.445527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-946acf9b-23a0-4476-a5e1-348530a924e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:23.446009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-946acf9b-23a0-4476-a5e1-348530a924e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:23.512651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-946acf9b-23a0-4476-a5e1-348530a924e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:23.520220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-946acf9b-23a0-4476-a5e1-348530a924e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087352 May 26 13:11:23.522200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 672/1316] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:23 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:24.775714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2636eaa8-7e87-4b88-869c-9f4e4586f86a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:24.776332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2636eaa8-7e87-4b88-869c-9f4e4586f86a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:24.782945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2636eaa8-7e87-4b88-869c-9f4e4586f86a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:24.783653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2636eaa8-7e87-4b88-869c-9f4e4586f86a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:24.784277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2636eaa8-7e87-4b88-869c-9f4e4586f86a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:24.784719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2636eaa8-7e87-4b88-869c-9f4e4586f86a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:24.852889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2636eaa8-7e87-4b88-869c-9f4e4586f86a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:24.862435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2636eaa8-7e87-4b88-869c-9f4e4586f86a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.329223 May 26 13:11:24.863054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 645/1317] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:24 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:25.879883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-03443b5e-ddd5-4a9a-b8db-3b934b5f043f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:25.880527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-03443b5e-ddd5-4a9a-b8db-3b934b5f043f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:25.887871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03443b5e-ddd5-4a9a-b8db-3b934b5f043f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:25.888331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03443b5e-ddd5-4a9a-b8db-3b934b5f043f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:25.889137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03443b5e-ddd5-4a9a-b8db-3b934b5f043f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:25.889578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03443b5e-ddd5-4a9a-b8db-3b934b5f043f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:25.968722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03443b5e-ddd5-4a9a-b8db-3b934b5f043f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:25.976528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-03443b5e-ddd5-4a9a-b8db-3b934b5f043f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.100523 May 26 13:11:25.977197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 673/1318] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:25 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:26.994966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3acd70e5-04cf-448c-a36a-3ef75886bb81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:26.995515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3acd70e5-04cf-448c-a36a-3ef75886bb81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:27.002086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3acd70e5-04cf-448c-a36a-3ef75886bb81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:27.002544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3acd70e5-04cf-448c-a36a-3ef75886bb81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:27.003448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3acd70e5-04cf-448c-a36a-3ef75886bb81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:27.004157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3acd70e5-04cf-448c-a36a-3ef75886bb81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:27.068377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3acd70e5-04cf-448c-a36a-3ef75886bb81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:27.076798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3acd70e5-04cf-448c-a36a-3ef75886bb81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085903 May 26 13:11:27.077366 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 646/1319] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:26 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:28.093405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d142cff-2e39-4602-916c-14ab97e9536a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:28.094013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d142cff-2e39-4602-916c-14ab97e9536a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:28.100656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d142cff-2e39-4602-916c-14ab97e9536a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:28.101099 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d142cff-2e39-4602-916c-14ab97e9536a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:28.101862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d142cff-2e39-4602-916c-14ab97e9536a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:28.102292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d142cff-2e39-4602-916c-14ab97e9536a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:28.167741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d142cff-2e39-4602-916c-14ab97e9536a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:28.176539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d142cff-2e39-4602-916c-14ab97e9536a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087089 May 26 13:11:28.177120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 674/1320] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:28 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:29.193634 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6699d4a-f09a-4c5c-80ae-c0fb5247f4d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:29.194276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c6699d4a-f09a-4c5c-80ae-c0fb5247f4d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:29.201564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6699d4a-f09a-4c5c-80ae-c0fb5247f4d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:29.202029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6699d4a-f09a-4c5c-80ae-c0fb5247f4d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:29.203110 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6699d4a-f09a-4c5c-80ae-c0fb5247f4d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:29.203470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6699d4a-f09a-4c5c-80ae-c0fb5247f4d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:29.270238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c6699d4a-f09a-4c5c-80ae-c0fb5247f4d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:29.278131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6699d4a-f09a-4c5c-80ae-c0fb5247f4d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088290 May 26 13:11:29.278743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 647/1321] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:29 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:30.295122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d692cce2-baf8-4038-b19b-9a12ba9277a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:30.295741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d692cce2-baf8-4038-b19b-9a12ba9277a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:30.302380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d692cce2-baf8-4038-b19b-9a12ba9277a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:30.302872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d692cce2-baf8-4038-b19b-9a12ba9277a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:30.303642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d692cce2-baf8-4038-b19b-9a12ba9277a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:30.304081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d692cce2-baf8-4038-b19b-9a12ba9277a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:30.365319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d692cce2-baf8-4038-b19b-9a12ba9277a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:30.372891 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d692cce2-baf8-4038-b19b-9a12ba9277a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081918 May 26 13:11:30.377765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 675/1322] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:30 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:31.391037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-73749342-7ae8-43b3-8b80-19d7c5c6f3da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:31.391683 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-73749342-7ae8-43b3-8b80-19d7c5c6f3da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:31.398267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73749342-7ae8-43b3-8b80-19d7c5c6f3da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:31.398750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73749342-7ae8-43b3-8b80-19d7c5c6f3da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:31.399513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73749342-7ae8-43b3-8b80-19d7c5c6f3da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:31.399948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73749342-7ae8-43b3-8b80-19d7c5c6f3da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:31.466154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-73749342-7ae8-43b3-8b80-19d7c5c6f3da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:31.474134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-73749342-7ae8-43b3-8b80-19d7c5c6f3da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087208 May 26 13:11:31.474784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 648/1323] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:31 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:32.491840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aef11650-8ea5-4426-af8f-7bdc82d7a93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:32.492463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aef11650-8ea5-4426-af8f-7bdc82d7a93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:32.499155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aef11650-8ea5-4426-af8f-7bdc82d7a93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:32.499611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aef11650-8ea5-4426-af8f-7bdc82d7a93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:32.500497 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aef11650-8ea5-4426-af8f-7bdc82d7a93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:32.501830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aef11650-8ea5-4426-af8f-7bdc82d7a93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:32.569179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aef11650-8ea5-4426-af8f-7bdc82d7a93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:32.576846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aef11650-8ea5-4426-af8f-7bdc82d7a93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088845 May 26 13:11:32.577421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 676/1324] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:32 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:33.594075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ec7a63a-67e0-436e-8dfb-710128228c7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:33.594802 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ec7a63a-67e0-436e-8dfb-710128228c7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:33.602782 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec7a63a-67e0-436e-8dfb-710128228c7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:33.603242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec7a63a-67e0-436e-8dfb-710128228c7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:33.604027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec7a63a-67e0-436e-8dfb-710128228c7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:33.604471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec7a63a-67e0-436e-8dfb-710128228c7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:33.667678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ec7a63a-67e0-436e-8dfb-710128228c7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:33.675504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ec7a63a-67e0-436e-8dfb-710128228c7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085263 May 26 13:11:33.676081 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 649/1325] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:33 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:34.692872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50da3501-c17b-47bb-9795-19e716d2e0fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:34.693539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50da3501-c17b-47bb-9795-19e716d2e0fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:34.700141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50da3501-c17b-47bb-9795-19e716d2e0fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:34.700590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50da3501-c17b-47bb-9795-19e716d2e0fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:34.701358 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50da3501-c17b-47bb-9795-19e716d2e0fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:34.701791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50da3501-c17b-47bb-9795-19e716d2e0fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:34.764036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50da3501-c17b-47bb-9795-19e716d2e0fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:34.772715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50da3501-c17b-47bb-9795-19e716d2e0fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083807 May 26 13:11:34.783318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 677/1326] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:34 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:35.789337 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b54e527-8be3-4ca3-bb24-065935281bb6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:35.790101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b54e527-8be3-4ca3-bb24-065935281bb6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:35.796583 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b54e527-8be3-4ca3-bb24-065935281bb6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:35.797027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b54e527-8be3-4ca3-bb24-065935281bb6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:35.797785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b54e527-8be3-4ca3-bb24-065935281bb6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:35.798220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b54e527-8be3-4ca3-bb24-065935281bb6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:35.863620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b54e527-8be3-4ca3-bb24-065935281bb6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:35.871972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b54e527-8be3-4ca3-bb24-065935281bb6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086399 May 26 13:11:35.872547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 650/1327] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:35 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:11:36.889829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec4f0daa-83ca-44a8-bca0-40fc10175de6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:36.890437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec4f0daa-83ca-44a8-bca0-40fc10175de6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:36.897551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec4f0daa-83ca-44a8-bca0-40fc10175de6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:36.898009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec4f0daa-83ca-44a8-bca0-40fc10175de6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:36.898829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec4f0daa-83ca-44a8-bca0-40fc10175de6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:36.899273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec4f0daa-83ca-44a8-bca0-40fc10175de6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:36.963934 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec4f0daa-83ca-44a8-bca0-40fc10175de6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:36.972221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec4f0daa-83ca-44a8-bca0-40fc10175de6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086130 May 26 13:11:36.973023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 678/1328] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:36 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:37.989322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c39261a8-b72d-4a70-8c4f-e7e4b2bf8ac6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:37.989932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c39261a8-b72d-4a70-8c4f-e7e4b2bf8ac6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:37.996816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c39261a8-b72d-4a70-8c4f-e7e4b2bf8ac6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:37.997261 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c39261a8-b72d-4a70-8c4f-e7e4b2bf8ac6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:37.998036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c39261a8-b72d-4a70-8c4f-e7e4b2bf8ac6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:37.998468 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c39261a8-b72d-4a70-8c4f-e7e4b2bf8ac6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:38.071337 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c39261a8-b72d-4a70-8c4f-e7e4b2bf8ac6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:38.079141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c39261a8-b72d-4a70-8c4f-e7e4b2bf8ac6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.093549 May 26 13:11:38.079714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 651/1329] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:37 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:39.097298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-557f6c57-d48f-4925-9dde-c83b27370746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:39.097975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-557f6c57-d48f-4925-9dde-c83b27370746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:39.104748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-557f6c57-d48f-4925-9dde-c83b27370746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:39.105394 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-557f6c57-d48f-4925-9dde-c83b27370746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:39.106185 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-557f6c57-d48f-4925-9dde-c83b27370746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:39.106657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-557f6c57-d48f-4925-9dde-c83b27370746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:39.175706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-557f6c57-d48f-4925-9dde-c83b27370746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:39.183553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-557f6c57-d48f-4925-9dde-c83b27370746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090719 May 26 13:11:39.184128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 679/1330] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:39 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:40.200036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f340e73-f976-440d-b4b1-af9761b249c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:40.200687 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f340e73-f976-440d-b4b1-af9761b249c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:40.207398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f340e73-f976-440d-b4b1-af9761b249c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:40.208068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f340e73-f976-440d-b4b1-af9761b249c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:40.208849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f340e73-f976-440d-b4b1-af9761b249c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:40.209289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f340e73-f976-440d-b4b1-af9761b249c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:40.271912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f340e73-f976-440d-b4b1-af9761b249c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:40.279488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f340e73-f976-440d-b4b1-af9761b249c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083438 May 26 13:11:40.280064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 652/1331] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:40 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:41.297148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8185e2c0-0cbb-4877-8c55-d600eba5e80a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:41.297762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8185e2c0-0cbb-4877-8c55-d600eba5e80a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:41.305341 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8185e2c0-0cbb-4877-8c55-d600eba5e80a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:41.305812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8185e2c0-0cbb-4877-8c55-d600eba5e80a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:41.306598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8185e2c0-0cbb-4877-8c55-d600eba5e80a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:41.307037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8185e2c0-0cbb-4877-8c55-d600eba5e80a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:41.384696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8185e2c0-0cbb-4877-8c55-d600eba5e80a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:41.384696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8185e2c0-0cbb-4877-8c55-d600eba5e80a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089256 May 26 13:11:41.384696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 680/1332] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:41 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:42.399863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3a6955c-31d4-49f0-a1fc-716eb5074e7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:42.400479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3a6955c-31d4-49f0-a1fc-716eb5074e7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:42.407211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3a6955c-31d4-49f0-a1fc-716eb5074e7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:42.407669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3a6955c-31d4-49f0-a1fc-716eb5074e7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:42.408461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3a6955c-31d4-49f0-a1fc-716eb5074e7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:42.408892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3a6955c-31d4-49f0-a1fc-716eb5074e7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:42.476231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3a6955c-31d4-49f0-a1fc-716eb5074e7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:42.483766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3a6955c-31d4-49f0-a1fc-716eb5074e7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087867 May 26 13:11:42.484573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 653/1333] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:42 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:43.504022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6ef79425-bfe0-43fb-bcd9-8bcfa393efc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:43.505245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6ef79425-bfe0-43fb-bcd9-8bcfa393efc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:43.512070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ef79425-bfe0-43fb-bcd9-8bcfa393efc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:43.512518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ef79425-bfe0-43fb-bcd9-8bcfa393efc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:43.513493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ef79425-bfe0-43fb-bcd9-8bcfa393efc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:43.513716 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ef79425-bfe0-43fb-bcd9-8bcfa393efc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:43.575674 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6ef79425-bfe0-43fb-bcd9-8bcfa393efc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:43.583571 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6ef79425-bfe0-43fb-bcd9-8bcfa393efc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083635 May 26 13:11:43.584148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 681/1334] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:43 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:44.601249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cbaddf83-b930-45d9-b32c-d148f38882b1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:44.601859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cbaddf83-b930-45d9-b32c-d148f38882b1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:44.608530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cbaddf83-b930-45d9-b32c-d148f38882b1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:44.608976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cbaddf83-b930-45d9-b32c-d148f38882b1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:44.610088 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cbaddf83-b930-45d9-b32c-d148f38882b1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:44.610544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cbaddf83-b930-45d9-b32c-d148f38882b1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:44.674432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cbaddf83-b930-45d9-b32c-d148f38882b1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:44.682334 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cbaddf83-b930-45d9-b32c-d148f38882b1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085390 May 26 13:11:44.683023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 654/1335] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:44 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:45.700217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-faed74e8-d756-46a6-b44d-6088ade8a748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:45.700876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-faed74e8-d756-46a6-b44d-6088ade8a748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:45.709133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faed74e8-d756-46a6-b44d-6088ade8a748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:45.709583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faed74e8-d756-46a6-b44d-6088ade8a748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:45.710363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faed74e8-d756-46a6-b44d-6088ade8a748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:45.710907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faed74e8-d756-46a6-b44d-6088ade8a748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:45.775573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-faed74e8-d756-46a6-b44d-6088ade8a748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:45.784349 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-faed74e8-d756-46a6-b44d-6088ade8a748 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088886 May 26 13:11:45.792643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 682/1336] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:45 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:46.801279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-00ffc9a1-fd7d-480a-b4ad-8f9b187baa03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:46.801882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-00ffc9a1-fd7d-480a-b4ad-8f9b187baa03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:46.809096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00ffc9a1-fd7d-480a-b4ad-8f9b187baa03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:46.809759 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00ffc9a1-fd7d-480a-b4ad-8f9b187baa03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:46.810556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00ffc9a1-fd7d-480a-b4ad-8f9b187baa03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:46.810989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00ffc9a1-fd7d-480a-b4ad-8f9b187baa03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:46.879347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-00ffc9a1-fd7d-480a-b4ad-8f9b187baa03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:46.887185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-00ffc9a1-fd7d-480a-b4ad-8f9b187baa03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089599 May 26 13:11:46.887756 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 655/1337] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:46 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:47.903463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-59a0bbe9-c3af-42b3-b0a7-c1e48503480d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:47.904087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-59a0bbe9-c3af-42b3-b0a7-c1e48503480d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:47.910664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59a0bbe9-c3af-42b3-b0a7-c1e48503480d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:47.911123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59a0bbe9-c3af-42b3-b0a7-c1e48503480d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:47.911896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59a0bbe9-c3af-42b3-b0a7-c1e48503480d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:47.912336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59a0bbe9-c3af-42b3-b0a7-c1e48503480d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:47.974551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-59a0bbe9-c3af-42b3-b0a7-c1e48503480d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:47.982309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-59a0bbe9-c3af-42b3-b0a7-c1e48503480d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082866 May 26 13:11:47.982909 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 683/1338] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:47 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:48.999973 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d641d69-ff8c-478e-b610-a417d3abd77f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:49.000606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d641d69-ff8c-478e-b610-a417d3abd77f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:49.007303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d641d69-ff8c-478e-b610-a417d3abd77f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:49.007737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d641d69-ff8c-478e-b610-a417d3abd77f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:49.008508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d641d69-ff8c-478e-b610-a417d3abd77f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:49.008940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d641d69-ff8c-478e-b610-a417d3abd77f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:49.073571 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d641d69-ff8c-478e-b610-a417d3abd77f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:49.082368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d641d69-ff8c-478e-b610-a417d3abd77f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086464 May 26 13:11:49.082994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 656/1339] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:48 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:50.102421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6425ddc9-17cb-4420-a100-0e6f03880083 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:50.103069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6425ddc9-17cb-4420-a100-0e6f03880083 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:50.113610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6425ddc9-17cb-4420-a100-0e6f03880083 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:50.113835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6425ddc9-17cb-4420-a100-0e6f03880083 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:50.114751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6425ddc9-17cb-4420-a100-0e6f03880083 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:50.115481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6425ddc9-17cb-4420-a100-0e6f03880083 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:50.184064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6425ddc9-17cb-4420-a100-0e6f03880083 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:50.192206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6425ddc9-17cb-4420-a100-0e6f03880083 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.095297 May 26 13:11:50.192798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 684/1340] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:50 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:11:51.208430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65102fc8-df19-4a53-a595-72540075dc2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:51.209037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65102fc8-df19-4a53-a595-72540075dc2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:51.215912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65102fc8-df19-4a53-a595-72540075dc2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:51.216363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65102fc8-df19-4a53-a595-72540075dc2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:51.217145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65102fc8-df19-4a53-a595-72540075dc2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:51.217602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65102fc8-df19-4a53-a595-72540075dc2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:51.280816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65102fc8-df19-4a53-a595-72540075dc2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:51.288519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65102fc8-df19-4a53-a595-72540075dc2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083939 May 26 13:11:51.289084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 657/1341] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:51 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:52.305765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-201d80d0-42c1-4081-9264-6e29ad069f85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:52.306429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-201d80d0-42c1-4081-9264-6e29ad069f85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:52.308225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:52.313614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-201d80d0-42c1-4081-9264-6e29ad069f85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:52.319234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-201d80d0-42c1-4081-9264-6e29ad069f85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:52.319234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-201d80d0-42c1-4081-9264-6e29ad069f85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:52.319234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-201d80d0-42c1-4081-9264-6e29ad069f85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:52.319234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:52.378190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-201d80d0-42c1-4081-9264-6e29ad069f85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:52.385681 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-201d80d0-42c1-4081-9264-6e29ad069f85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084242 May 26 13:11:52.386263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 685/1342] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:52 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:53.345105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:11:53.345814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:11:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:11:53.403989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c9d3e769-b6ed-4c2e-abde-0327e84269b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:53.404631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c9d3e769-b6ed-4c2e-abde-0327e84269b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:53.406660 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:53.411629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9d3e769-b6ed-4c2e-abde-0327e84269b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:53.412074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9d3e769-b6ed-4c2e-abde-0327e84269b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:53.412853 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9d3e769-b6ed-4c2e-abde-0327e84269b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:53.413302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9d3e769-b6ed-4c2e-abde-0327e84269b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:53.477797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c9d3e769-b6ed-4c2e-abde-0327e84269b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:53.488023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c9d3e769-b6ed-4c2e-abde-0327e84269b6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088706 May 26 13:11:53.488612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 658/1343] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:53 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:54.507138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87edadfa-5200-48b9-a34c-b1ab3a9983ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:54.507815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87edadfa-5200-48b9-a34c-b1ab3a9983ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:54.518038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87edadfa-5200-48b9-a34c-b1ab3a9983ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:54.518492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87edadfa-5200-48b9-a34c-b1ab3a9983ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:54.519296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87edadfa-5200-48b9-a34c-b1ab3a9983ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:54.519741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87edadfa-5200-48b9-a34c-b1ab3a9983ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:54.582863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-87edadfa-5200-48b9-a34c-b1ab3a9983ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:54.591120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87edadfa-5200-48b9-a34c-b1ab3a9983ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089355 May 26 13:11:54.591688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 686/1344] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:54 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:55.607866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c0534d85-902a-4fae-94fd-f8d5e7716ba4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:55.608432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c0534d85-902a-4fae-94fd-f8d5e7716ba4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:55.615432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0534d85-902a-4fae-94fd-f8d5e7716ba4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:55.615885 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0534d85-902a-4fae-94fd-f8d5e7716ba4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:55.616645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0534d85-902a-4fae-94fd-f8d5e7716ba4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:55.617078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0534d85-902a-4fae-94fd-f8d5e7716ba4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:55.621213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=90 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:55.684772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0534d85-902a-4fae-94fd-f8d5e7716ba4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:55.692536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c0534d85-902a-4fae-94fd-f8d5e7716ba4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089275 May 26 13:11:55.693311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 659/1345] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:55 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:56.709701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40e9ae2c-d736-4c3f-9919-60726fd8d0ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:56.710334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40e9ae2c-d736-4c3f-9919-60726fd8d0ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:56.717626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40e9ae2c-d736-4c3f-9919-60726fd8d0ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:56.718076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40e9ae2c-d736-4c3f-9919-60726fd8d0ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:56.718887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40e9ae2c-d736-4c3f-9919-60726fd8d0ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:56.719331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40e9ae2c-d736-4c3f-9919-60726fd8d0ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:56.784071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-40e9ae2c-d736-4c3f-9919-60726fd8d0ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:56.791776 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40e9ae2c-d736-4c3f-9919-60726fd8d0ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085843 May 26 13:11:56.792271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 687/1346] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:56 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:57.808603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-86a8019d-091b-4fa1-9245-ac63d65196a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:57.809358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-86a8019d-091b-4fa1-9245-ac63d65196a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:57.816039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86a8019d-091b-4fa1-9245-ac63d65196a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:57.816486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86a8019d-091b-4fa1-9245-ac63d65196a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:57.817257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86a8019d-091b-4fa1-9245-ac63d65196a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:57.817693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86a8019d-091b-4fa1-9245-ac63d65196a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:57.880096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-86a8019d-091b-4fa1-9245-ac63d65196a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:57.888939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-86a8019d-091b-4fa1-9245-ac63d65196a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084507 May 26 13:11:57.889528 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 660/1347] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:57 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:11:58.907855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-659ea0c1-2987-4d13-96e4-6bf78162d50d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:11:58.907855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-659ea0c1-2987-4d13-96e4-6bf78162d50d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:11:58.914300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-659ea0c1-2987-4d13-96e4-6bf78162d50d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:58.914785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-659ea0c1-2987-4d13-96e4-6bf78162d50d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:58.915577 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-659ea0c1-2987-4d13-96e4-6bf78162d50d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:11:58.916002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-659ea0c1-2987-4d13-96e4-6bf78162d50d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:11:59.013376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-659ea0c1-2987-4d13-96e4-6bf78162d50d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:11:59.021154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-659ea0c1-2987-4d13-96e4-6bf78162d50d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.119660 May 26 13:11:59.021645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 688/1348] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:11:58 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:00.038951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-901b1245-d5d4-4880-8556-1f0d973245e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:00.039579 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-901b1245-d5d4-4880-8556-1f0d973245e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:00.046121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-901b1245-d5d4-4880-8556-1f0d973245e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:00.046618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-901b1245-d5d4-4880-8556-1f0d973245e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:00.047392 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-901b1245-d5d4-4880-8556-1f0d973245e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:00.047820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-901b1245-d5d4-4880-8556-1f0d973245e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:00.108657 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-901b1245-d5d4-4880-8556-1f0d973245e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:00.116363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-901b1245-d5d4-4880-8556-1f0d973245e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081408 May 26 13:12:00.126734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 661/1349] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:00 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:01.142233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2f114b9-a5f0-423f-8989-0c3f9b1714f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:01.142947 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2f114b9-a5f0-423f-8989-0c3f9b1714f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:01.149860 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2f114b9-a5f0-423f-8989-0c3f9b1714f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:01.150318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2f114b9-a5f0-423f-8989-0c3f9b1714f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:01.155639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2f114b9-a5f0-423f-8989-0c3f9b1714f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:01.155639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2f114b9-a5f0-423f-8989-0c3f9b1714f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:01.221957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2f114b9-a5f0-423f-8989-0c3f9b1714f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:01.229979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2f114b9-a5f0-423f-8989-0c3f9b1714f7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091906 May 26 13:12:01.230583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 689/1350] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:01 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:02.252917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d04b4487-51b6-439e-8351-d63e2d2ec19b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:02.253535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d04b4487-51b6-439e-8351-d63e2d2ec19b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:02.260179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d04b4487-51b6-439e-8351-d63e2d2ec19b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:02.260633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d04b4487-51b6-439e-8351-d63e2d2ec19b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:02.261445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d04b4487-51b6-439e-8351-d63e2d2ec19b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:02.261900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d04b4487-51b6-439e-8351-d63e2d2ec19b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:02.327930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d04b4487-51b6-439e-8351-d63e2d2ec19b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:02.335676 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d04b4487-51b6-439e-8351-d63e2d2ec19b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086720 May 26 13:12:02.336243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 662/1351] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:02 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:03.354481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b767ff5-8957-4ca5-b48a-11767ee5c17e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:03.355116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b767ff5-8957-4ca5-b48a-11767ee5c17e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:03.361992 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b767ff5-8957-4ca5-b48a-11767ee5c17e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:03.362445 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b767ff5-8957-4ca5-b48a-11767ee5c17e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:03.363260 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b767ff5-8957-4ca5-b48a-11767ee5c17e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:03.363693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b767ff5-8957-4ca5-b48a-11767ee5c17e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:03.433557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b767ff5-8957-4ca5-b48a-11767ee5c17e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:03.441781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b767ff5-8957-4ca5-b48a-11767ee5c17e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091342 May 26 13:12:03.442349 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 690/1352] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:03 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:04.459150 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8cbc2b40-6217-489b-ab2d-d8e52f3033f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:04.459764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8cbc2b40-6217-489b-ab2d-d8e52f3033f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:04.467019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cbc2b40-6217-489b-ab2d-d8e52f3033f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:04.467607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cbc2b40-6217-489b-ab2d-d8e52f3033f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:04.468396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cbc2b40-6217-489b-ab2d-d8e52f3033f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:04.468832 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cbc2b40-6217-489b-ab2d-d8e52f3033f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:04.538939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8cbc2b40-6217-489b-ab2d-d8e52f3033f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:04.546936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8cbc2b40-6217-489b-ab2d-d8e52f3033f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091588 May 26 13:12:04.547525 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 663/1353] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:04 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:05.564804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-07da05d8-f127-411a-b62a-86e71fd5aa0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:05.565334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-07da05d8-f127-411a-b62a-86e71fd5aa0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:05.571755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07da05d8-f127-411a-b62a-86e71fd5aa0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:05.572205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07da05d8-f127-411a-b62a-86e71fd5aa0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:05.572958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07da05d8-f127-411a-b62a-86e71fd5aa0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:05.573390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07da05d8-f127-411a-b62a-86e71fd5aa0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:05.633943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07da05d8-f127-411a-b62a-86e71fd5aa0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:05.641783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-07da05d8-f127-411a-b62a-86e71fd5aa0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.080921 May 26 13:12:05.642340 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 691/1354] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:05 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:06.658688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-037cb2e2-c1e9-4c5a-8601-edb715c59af3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:06.659342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-037cb2e2-c1e9-4c5a-8601-edb715c59af3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:06.665879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-037cb2e2-c1e9-4c5a-8601-edb715c59af3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:06.666328 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-037cb2e2-c1e9-4c5a-8601-edb715c59af3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:06.667112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-037cb2e2-c1e9-4c5a-8601-edb715c59af3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:06.667548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-037cb2e2-c1e9-4c5a-8601-edb715c59af3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:06.727881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-037cb2e2-c1e9-4c5a-8601-edb715c59af3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:06.737030 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-037cb2e2-c1e9-4c5a-8601-edb715c59af3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082238 May 26 13:12:06.737595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 664/1355] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:06 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:07.753267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-769c1f34-4edb-4711-86f5-5073b40712fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:07.753873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-769c1f34-4edb-4711-86f5-5073b40712fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:07.760422 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-769c1f34-4edb-4711-86f5-5073b40712fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:07.760879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-769c1f34-4edb-4711-86f5-5073b40712fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:07.761640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-769c1f34-4edb-4711-86f5-5073b40712fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:07.762593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-769c1f34-4edb-4711-86f5-5073b40712fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:07.825172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-769c1f34-4edb-4711-86f5-5073b40712fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:07.833117 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-769c1f34-4edb-4711-86f5-5073b40712fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083692 May 26 13:12:07.833691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 692/1356] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:07 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:08.850639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6881dd4f-559d-45df-89ce-9ae0b11a4b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:08.851273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6881dd4f-559d-45df-89ce-9ae0b11a4b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:08.859049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6881dd4f-559d-45df-89ce-9ae0b11a4b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:08.859515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6881dd4f-559d-45df-89ce-9ae0b11a4b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:08.860300 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6881dd4f-559d-45df-89ce-9ae0b11a4b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:08.860746 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6881dd4f-559d-45df-89ce-9ae0b11a4b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:08.922431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6881dd4f-559d-45df-89ce-9ae0b11a4b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:08.929939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6881dd4f-559d-45df-89ce-9ae0b11a4b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083237 May 26 13:12:08.930495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 665/1357] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:08 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:09.946744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1dc3a7da-cae6-4a8c-9bee-55d31c25882d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:09.947359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1dc3a7da-cae6-4a8c-9bee-55d31c25882d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:09.954640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc3a7da-cae6-4a8c-9bee-55d31c25882d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:09.955158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc3a7da-cae6-4a8c-9bee-55d31c25882d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:09.955929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc3a7da-cae6-4a8c-9bee-55d31c25882d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:09.956368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc3a7da-cae6-4a8c-9bee-55d31c25882d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:10.277534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dc3a7da-cae6-4a8c-9bee-55d31c25882d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:10.285314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1dc3a7da-cae6-4a8c-9bee-55d31c25882d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.342351 May 26 13:12:10.285884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 693/1358] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:09 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:11.301859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd5b0896-8b70-47a4-9ec0-63d9883b7a35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:11.302468 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd5b0896-8b70-47a4-9ec0-63d9883b7a35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:11.309691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd5b0896-8b70-47a4-9ec0-63d9883b7a35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:11.310138 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd5b0896-8b70-47a4-9ec0-63d9883b7a35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:11.310929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd5b0896-8b70-47a4-9ec0-63d9883b7a35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:11.311407 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd5b0896-8b70-47a4-9ec0-63d9883b7a35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:11.372834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bd5b0896-8b70-47a4-9ec0-63d9883b7a35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:11.380418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd5b0896-8b70-47a4-9ec0-63d9883b7a35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082354 May 26 13:12:11.380986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 666/1359] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:11 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:12.401373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2fd9c60-6816-428d-ac5a-b6413250acee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:12.402036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2fd9c60-6816-428d-ac5a-b6413250acee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:12.408916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c60-6816-428d-ac5a-b6413250acee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:12.409364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c60-6816-428d-ac5a-b6413250acee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:12.410145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c60-6816-428d-ac5a-b6413250acee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:12.410606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2fd9c60-6816-428d-ac5a-b6413250acee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:12.474850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2fd9c60-6816-428d-ac5a-b6413250acee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:12.483133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2fd9c60-6816-428d-ac5a-b6413250acee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085747 May 26 13:12:12.484194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 694/1360] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:12 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:13.501002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16613117-e454-4697-ba1d-0ee51cfb251e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:13.501815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16613117-e454-4697-ba1d-0ee51cfb251e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:13.508156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16613117-e454-4697-ba1d-0ee51cfb251e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:13.508599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16613117-e454-4697-ba1d-0ee51cfb251e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:13.509363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16613117-e454-4697-ba1d-0ee51cfb251e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:13.509791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16613117-e454-4697-ba1d-0ee51cfb251e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:13.574074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16613117-e454-4697-ba1d-0ee51cfb251e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:13.583124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16613117-e454-4697-ba1d-0ee51cfb251e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086708 May 26 13:12:13.587456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 667/1361] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:13 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:14.600642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7e3d61a-ceef-40de-bfa0-ca09ae2c2043 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:14.601198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7e3d61a-ceef-40de-bfa0-ca09ae2c2043 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:14.608439 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7e3d61a-ceef-40de-bfa0-ca09ae2c2043 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:14.609158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7e3d61a-ceef-40de-bfa0-ca09ae2c2043 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:14.609921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7e3d61a-ceef-40de-bfa0-ca09ae2c2043 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:14.610362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7e3d61a-ceef-40de-bfa0-ca09ae2c2043 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:14.671414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7e3d61a-ceef-40de-bfa0-ca09ae2c2043 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:14.678931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7e3d61a-ceef-40de-bfa0-ca09ae2c2043 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082139 May 26 13:12:14.679491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 695/1362] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:14 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:15.696478 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1fbd406-514b-4d84-ab7b-30b6a64083b4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:15.697112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1fbd406-514b-4d84-ab7b-30b6a64083b4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:15.703960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1fbd406-514b-4d84-ab7b-30b6a64083b4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:15.704419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1fbd406-514b-4d84-ab7b-30b6a64083b4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:15.705201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1fbd406-514b-4d84-ab7b-30b6a64083b4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:15.706177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1fbd406-514b-4d84-ab7b-30b6a64083b4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:15.770397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1fbd406-514b-4d84-ab7b-30b6a64083b4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:15.778545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1fbd406-514b-4d84-ab7b-30b6a64083b4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085831 May 26 13:12:15.779165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 668/1363] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:15 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:16.795361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff9c95f0-ab53-4e90-b8d9-21eb429e2a39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:16.795981 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff9c95f0-ab53-4e90-b8d9-21eb429e2a39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:16.802449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff9c95f0-ab53-4e90-b8d9-21eb429e2a39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:16.802942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff9c95f0-ab53-4e90-b8d9-21eb429e2a39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:16.803715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff9c95f0-ab53-4e90-b8d9-21eb429e2a39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:16.804158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff9c95f0-ab53-4e90-b8d9-21eb429e2a39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:16.873181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff9c95f0-ab53-4e90-b8d9-21eb429e2a39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:16.880683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff9c95f0-ab53-4e90-b8d9-21eb429e2a39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089253 May 26 13:12:16.881241 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 696/1364] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:16 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:17.897235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6dd9125-22f1-4da6-be8a-b11bef28986f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:17.897852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6dd9125-22f1-4da6-be8a-b11bef28986f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:17.905470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-22f1-4da6-be8a-b11bef28986f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:17.905926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-22f1-4da6-be8a-b11bef28986f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:17.906727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-22f1-4da6-be8a-b11bef28986f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:17.907168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-22f1-4da6-be8a-b11bef28986f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:17.970121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6dd9125-22f1-4da6-be8a-b11bef28986f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:17.977848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6dd9125-22f1-4da6-be8a-b11bef28986f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084402 May 26 13:12:17.978423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 669/1365] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:17 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:18.995754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-110e3edc-4950-4779-92be-f6269c1cb913 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:18.996968 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-110e3edc-4950-4779-92be-f6269c1cb913 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:19.003470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-110e3edc-4950-4779-92be-f6269c1cb913 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:19.003939 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-110e3edc-4950-4779-92be-f6269c1cb913 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:19.004689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-110e3edc-4950-4779-92be-f6269c1cb913 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:19.005134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-110e3edc-4950-4779-92be-f6269c1cb913 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:19.072827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-110e3edc-4950-4779-92be-f6269c1cb913 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:19.076758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-110e3edc-4950-4779-92be-f6269c1cb913 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084820 May 26 13:12:19.077325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 697/1366] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:18 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:20.093820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5a0110e9-c701-4a85-b736-7bdcef093183 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:20.094370 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5a0110e9-c701-4a85-b736-7bdcef093183 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:20.100592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a0110e9-c701-4a85-b736-7bdcef093183 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:20.101040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a0110e9-c701-4a85-b736-7bdcef093183 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:20.101801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a0110e9-c701-4a85-b736-7bdcef093183 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:20.102235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a0110e9-c701-4a85-b736-7bdcef093183 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:20.163357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5a0110e9-c701-4a85-b736-7bdcef093183 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:20.171040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5a0110e9-c701-4a85-b736-7bdcef093183 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081427 May 26 13:12:20.171876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 670/1367] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:20 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:21.187374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20f22d1f-afa6-48c1-aa7c-34d4f6a39963 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:21.187981 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-20f22d1f-afa6-48c1-aa7c-34d4f6a39963 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:21.194463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20f22d1f-afa6-48c1-aa7c-34d4f6a39963 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:21.194955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20f22d1f-afa6-48c1-aa7c-34d4f6a39963 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:21.195717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20f22d1f-afa6-48c1-aa7c-34d4f6a39963 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:21.196151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20f22d1f-afa6-48c1-aa7c-34d4f6a39963 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:21.257818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20f22d1f-afa6-48c1-aa7c-34d4f6a39963 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:21.266404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-20f22d1f-afa6-48c1-aa7c-34d4f6a39963 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083391 May 26 13:12:21.267017 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 698/1368] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:21 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:22.284227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46d99552-1153-414c-8fbb-1fe184ec2f64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:22.284872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46d99552-1153-414c-8fbb-1fe184ec2f64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:22.291223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46d99552-1153-414c-8fbb-1fe184ec2f64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:22.291678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46d99552-1153-414c-8fbb-1fe184ec2f64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:22.292460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46d99552-1153-414c-8fbb-1fe184ec2f64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:22.292934 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46d99552-1153-414c-8fbb-1fe184ec2f64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:22.359522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46d99552-1153-414c-8fbb-1fe184ec2f64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:22.369143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46d99552-1153-414c-8fbb-1fe184ec2f64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088816 May 26 13:12:22.369728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 671/1369] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:22 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:23.385958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e52cef99-5ff6-4c58-aa6e-c61e23fd97f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:23.386700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e52cef99-5ff6-4c58-aa6e-c61e23fd97f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:23.389835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:12:23.394755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e52cef99-5ff6-4c58-aa6e-c61e23fd97f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:23.395207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e52cef99-5ff6-4c58-aa6e-c61e23fd97f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:23.395978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e52cef99-5ff6-4c58-aa6e-c61e23fd97f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:23.396415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e52cef99-5ff6-4c58-aa6e-c61e23fd97f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:23.461274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e52cef99-5ff6-4c58-aa6e-c61e23fd97f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:23.469200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e52cef99-5ff6-4c58-aa6e-c61e23fd97f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087033 May 26 13:12:23.469782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 699/1370] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:23 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:24.486888 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-78796c93-7e2f-4803-830c-03f844f7e610 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:24.487484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-78796c93-7e2f-4803-830c-03f844f7e610 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:24.489513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:12:24.494422 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78796c93-7e2f-4803-830c-03f844f7e610 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:24.495042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78796c93-7e2f-4803-830c-03f844f7e610 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:24.495872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78796c93-7e2f-4803-830c-03f844f7e610 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:24.496828 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78796c93-7e2f-4803-830c-03f844f7e610 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:24.558096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78796c93-7e2f-4803-830c-03f844f7e610 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:24.566207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-78796c93-7e2f-4803-830c-03f844f7e610 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083713 May 26 13:12:24.566856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 672/1371] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:24 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:25.584686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a390ff4-1383-4b05-b078-be9e5c733bd7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:25.585247 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a390ff4-1383-4b05-b078-be9e5c733bd7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:25.592350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a390ff4-1383-4b05-b078-be9e5c733bd7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:25.592798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a390ff4-1383-4b05-b078-be9e5c733bd7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:25.593555 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a390ff4-1383-4b05-b078-be9e5c733bd7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:25.594009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a390ff4-1383-4b05-b078-be9e5c733bd7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:25.597853 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=90 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:12:25.659569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a390ff4-1383-4b05-b078-be9e5c733bd7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:25.666953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a390ff4-1383-4b05-b078-be9e5c733bd7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086371 May 26 13:12:25.667516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 700/1372] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:25 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:26.684448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-39e6c921-a81c-4c9e-9a66-bcc9f13ab817 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:26.685285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-39e6c921-a81c-4c9e-9a66-bcc9f13ab817 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:26.691602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39e6c921-a81c-4c9e-9a66-bcc9f13ab817 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:26.692046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39e6c921-a81c-4c9e-9a66-bcc9f13ab817 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:26.692807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39e6c921-a81c-4c9e-9a66-bcc9f13ab817 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:26.693319 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39e6c921-a81c-4c9e-9a66-bcc9f13ab817 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:26.695918 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:12:26.754679 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-39e6c921-a81c-4c9e-9a66-bcc9f13ab817 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:26.762629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-39e6c921-a81c-4c9e-9a66-bcc9f13ab817 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082323 May 26 13:12:26.763214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 673/1373] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:26 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:27.780109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7589abd1-2719-41b1-8a31-ee406c1f3969 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:27.780748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7589abd1-2719-41b1-8a31-ee406c1f3969 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:27.787422 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7589abd1-2719-41b1-8a31-ee406c1f3969 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:27.787896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7589abd1-2719-41b1-8a31-ee406c1f3969 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:27.788661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7589abd1-2719-41b1-8a31-ee406c1f3969 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:27.789098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7589abd1-2719-41b1-8a31-ee406c1f3969 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:27.855306 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7589abd1-2719-41b1-8a31-ee406c1f3969 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:27.863658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7589abd1-2719-41b1-8a31-ee406c1f3969 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088064 May 26 13:12:27.864219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 701/1374] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:27 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:28.881297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-573f8b7a-9dc6-4c52-9423-2b405e6a324e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:28.881909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-573f8b7a-9dc6-4c52-9423-2b405e6a324e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:28.889625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-573f8b7a-9dc6-4c52-9423-2b405e6a324e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:28.890082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-573f8b7a-9dc6-4c52-9423-2b405e6a324e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:28.890884 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-573f8b7a-9dc6-4c52-9423-2b405e6a324e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:28.891327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-573f8b7a-9dc6-4c52-9423-2b405e6a324e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:28.955180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-573f8b7a-9dc6-4c52-9423-2b405e6a324e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:28.964573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-573f8b7a-9dc6-4c52-9423-2b405e6a324e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087239 May 26 13:12:28.965430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 674/1375] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:28 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:29.983917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94f9f6d7-d252-47e7-acdf-04117615038b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:29.984749 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-94f9f6d7-d252-47e7-acdf-04117615038b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:29.991374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94f9f6d7-d252-47e7-acdf-04117615038b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:29.991832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94f9f6d7-d252-47e7-acdf-04117615038b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:29.992613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94f9f6d7-d252-47e7-acdf-04117615038b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:29.993052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94f9f6d7-d252-47e7-acdf-04117615038b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:30.061401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94f9f6d7-d252-47e7-acdf-04117615038b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:30.069569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94f9f6d7-d252-47e7-acdf-04117615038b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091178 May 26 13:12:30.070155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 702/1376] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:29 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:31.087244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd647380-6643-4878-87ba-fc27119b3d66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:31.087868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd647380-6643-4878-87ba-fc27119b3d66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:31.094494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd647380-6643-4878-87ba-fc27119b3d66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:31.094974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd647380-6643-4878-87ba-fc27119b3d66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:31.095724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd647380-6643-4878-87ba-fc27119b3d66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:31.096163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd647380-6643-4878-87ba-fc27119b3d66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:31.163032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd647380-6643-4878-87ba-fc27119b3d66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:31.171536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd647380-6643-4878-87ba-fc27119b3d66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088048 May 26 13:12:31.172120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 675/1377] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:31 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:32.188870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c4d65f7e-a657-4a05-ba83-5a89c7255b64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:32.189514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4d65f7e-a657-4a05-ba83-5a89c7255b64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:32.196050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4d65f7e-a657-4a05-ba83-5a89c7255b64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:32.196500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4d65f7e-a657-4a05-ba83-5a89c7255b64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:32.197260 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4d65f7e-a657-4a05-ba83-5a89c7255b64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:32.197694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4d65f7e-a657-4a05-ba83-5a89c7255b64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:32.258180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4d65f7e-a657-4a05-ba83-5a89c7255b64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:32.267130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c4d65f7e-a657-4a05-ba83-5a89c7255b64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082829 May 26 13:12:32.267697 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 703/1378] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:32 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:33.284588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a0a7aaba-55d7-4693-b258-8f5ce8abaa29 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:33.285209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a0a7aaba-55d7-4693-b258-8f5ce8abaa29 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:33.291913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaba-55d7-4693-b258-8f5ce8abaa29 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:33.292369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaba-55d7-4693-b258-8f5ce8abaa29 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:33.293189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaba-55d7-4693-b258-8f5ce8abaa29 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:33.293630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaba-55d7-4693-b258-8f5ce8abaa29 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:33.356708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a0a7aaba-55d7-4693-b258-8f5ce8abaa29 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:33.364994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a0a7aaba-55d7-4693-b258-8f5ce8abaa29 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085117 May 26 13:12:33.365567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 676/1379] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:33 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:34.382443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0cafb642-b1c6-4218-8777-e8bc15db68cd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:34.383118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0cafb642-b1c6-4218-8777-e8bc15db68cd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:34.389916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0cafb642-b1c6-4218-8777-e8bc15db68cd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:34.390372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0cafb642-b1c6-4218-8777-e8bc15db68cd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:34.391189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0cafb642-b1c6-4218-8777-e8bc15db68cd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:34.391632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0cafb642-b1c6-4218-8777-e8bc15db68cd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:34.453296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0cafb642-b1c6-4218-8777-e8bc15db68cd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:34.461696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0cafb642-b1c6-4218-8777-e8bc15db68cd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083264 May 26 13:12:34.462263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 704/1380] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:34 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:35.479769 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-84dc8476-c026-44bb-95f7-d34c47011d70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:35.480393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-84dc8476-c026-44bb-95f7-d34c47011d70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:35.488001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84dc8476-c026-44bb-95f7-d34c47011d70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:35.488453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84dc8476-c026-44bb-95f7-d34c47011d70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:35.489237 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84dc8476-c026-44bb-95f7-d34c47011d70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:35.489681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84dc8476-c026-44bb-95f7-d34c47011d70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:35.553085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84dc8476-c026-44bb-95f7-d34c47011d70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:35.560746 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-84dc8476-c026-44bb-95f7-d34c47011d70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084923 May 26 13:12:35.561312 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 677/1381] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:35 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:36.577804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e516ebd-7f70-46bc-8a05-494127f6a73a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:36.578632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e516ebd-7f70-46bc-8a05-494127f6a73a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:36.587599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e516ebd-7f70-46bc-8a05-494127f6a73a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:36.588063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e516ebd-7f70-46bc-8a05-494127f6a73a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:36.588844 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e516ebd-7f70-46bc-8a05-494127f6a73a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:36.589279 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e516ebd-7f70-46bc-8a05-494127f6a73a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:36.670580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e516ebd-7f70-46bc-8a05-494127f6a73a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:36.683596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e516ebd-7f70-46bc-8a05-494127f6a73a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.109899 May 26 13:12:36.684172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 705/1382] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:36 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:37.700103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1d99549-2594-4532-b6a2-825129d8b488 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:37.701066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1d99549-2594-4532-b6a2-825129d8b488 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:37.707551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1d99549-2594-4532-b6a2-825129d8b488 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:37.708008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1d99549-2594-4532-b6a2-825129d8b488 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:37.709457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1d99549-2594-4532-b6a2-825129d8b488 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:37.709457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1d99549-2594-4532-b6a2-825129d8b488 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:37.772826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1d99549-2594-4532-b6a2-825129d8b488 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:37.780725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1d99549-2594-4532-b6a2-825129d8b488 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084582 May 26 13:12:37.781462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 678/1383] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:37 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:37.984365 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:12:37.984614 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:12:38.797303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-11d50c7f-f32e-4cc3-bf62-49bb31ff61cc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:38.797942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-11d50c7f-f32e-4cc3-bf62-49bb31ff61cc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:38.804892 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11d50c7f-f32e-4cc3-bf62-49bb31ff61cc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:38.805339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11d50c7f-f32e-4cc3-bf62-49bb31ff61cc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:38.806183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11d50c7f-f32e-4cc3-bf62-49bb31ff61cc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:38.806648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11d50c7f-f32e-4cc3-bf62-49bb31ff61cc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:38.868602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-11d50c7f-f32e-4cc3-bf62-49bb31ff61cc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:38.876021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-11d50c7f-f32e-4cc3-bf62-49bb31ff61cc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082728 May 26 13:12:38.876581 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 706/1384] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:38 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:39.892428 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c7de8d9-fb1e-49f2-8cf3-a9cf9c8aae86 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:39.893051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c7de8d9-fb1e-49f2-8cf3-a9cf9c8aae86 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:39.900650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c7de8d9-fb1e-49f2-8cf3-a9cf9c8aae86 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:39.901148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c7de8d9-fb1e-49f2-8cf3-a9cf9c8aae86 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:39.901917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c7de8d9-fb1e-49f2-8cf3-a9cf9c8aae86 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:39.902391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c7de8d9-fb1e-49f2-8cf3-a9cf9c8aae86 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:39.966478 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c7de8d9-fb1e-49f2-8cf3-a9cf9c8aae86 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:39.974759 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c7de8d9-fb1e-49f2-8cf3-a9cf9c8aae86 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085530 May 26 13:12:39.975322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 679/1385] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:39 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:40.992181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-077f313c-6a1a-45d1-a40d-2c7ac3a5f9b0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:40.992747 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-077f313c-6a1a-45d1-a40d-2c7ac3a5f9b0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:40.999530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-077f313c-6a1a-45d1-a40d-2c7ac3a5f9b0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:40.999985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-077f313c-6a1a-45d1-a40d-2c7ac3a5f9b0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:41.000757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-077f313c-6a1a-45d1-a40d-2c7ac3a5f9b0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:41.001197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-077f313c-6a1a-45d1-a40d-2c7ac3a5f9b0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:41.064080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-077f313c-6a1a-45d1-a40d-2c7ac3a5f9b0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:41.071830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-077f313c-6a1a-45d1-a40d-2c7ac3a5f9b0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083679 May 26 13:12:41.072814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 707/1386] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:40 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:42.088874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9db9e4fa-cc16-4f19-bdc5-2d34a97ced3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:42.089494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9db9e4fa-cc16-4f19-bdc5-2d34a97ced3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:42.096032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9db9e4fa-cc16-4f19-bdc5-2d34a97ced3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:42.096494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9db9e4fa-cc16-4f19-bdc5-2d34a97ced3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:42.097275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9db9e4fa-cc16-4f19-bdc5-2d34a97ced3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:42.097721 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9db9e4fa-cc16-4f19-bdc5-2d34a97ced3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:42.159409 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9db9e4fa-cc16-4f19-bdc5-2d34a97ced3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:42.166930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9db9e4fa-cc16-4f19-bdc5-2d34a97ced3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082044 May 26 13:12:42.167486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 680/1387] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:42 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:12:43.183530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-29a712f1-b3c8-42fe-bd4e-f911024677e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:43.184242 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-29a712f1-b3c8-42fe-bd4e-f911024677e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:43.191226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29a712f1-b3c8-42fe-bd4e-f911024677e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:43.191677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29a712f1-b3c8-42fe-bd4e-f911024677e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:43.192544 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29a712f1-b3c8-42fe-bd4e-f911024677e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:43.192974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29a712f1-b3c8-42fe-bd4e-f911024677e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:43.260065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-29a712f1-b3c8-42fe-bd4e-f911024677e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:43.267871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-29a712f1-b3c8-42fe-bd4e-f911024677e5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088133 May 26 13:12:43.268493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 708/1388] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:43 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:44.288073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-43fd54e1-eff4-48fc-9ab7-fe91db888cb5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:44.288073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-43fd54e1-eff4-48fc-9ab7-fe91db888cb5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:44.295242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43fd54e1-eff4-48fc-9ab7-fe91db888cb5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:44.295696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43fd54e1-eff4-48fc-9ab7-fe91db888cb5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:44.296478 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43fd54e1-eff4-48fc-9ab7-fe91db888cb5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:44.296914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43fd54e1-eff4-48fc-9ab7-fe91db888cb5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:44.360696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43fd54e1-eff4-48fc-9ab7-fe91db888cb5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:44.369114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-43fd54e1-eff4-48fc-9ab7-fe91db888cb5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086186 May 26 13:12:44.369693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 681/1389] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:44 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:44.940245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:12:44.940490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:12:45.386965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b79ec67a-01eb-4e57-99a9-331bb8712a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:45.387602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b79ec67a-01eb-4e57-99a9-331bb8712a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:45.394408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b79ec67a-01eb-4e57-99a9-331bb8712a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:45.394888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b79ec67a-01eb-4e57-99a9-331bb8712a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:45.395659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b79ec67a-01eb-4e57-99a9-331bb8712a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:45.396099 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b79ec67a-01eb-4e57-99a9-331bb8712a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:45.459699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b79ec67a-01eb-4e57-99a9-331bb8712a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:45.468288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b79ec67a-01eb-4e57-99a9-331bb8712a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086098 May 26 13:12:45.468950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 709/1390] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:45 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:12:46.485612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1dea486-ac19-4584-a5bd-4fb53bf5f91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:46.486277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1dea486-ac19-4584-a5bd-4fb53bf5f91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:46.493153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1dea486-ac19-4584-a5bd-4fb53bf5f91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:46.493778 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1dea486-ac19-4584-a5bd-4fb53bf5f91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:46.494578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1dea486-ac19-4584-a5bd-4fb53bf5f91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:46.495021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1dea486-ac19-4584-a5bd-4fb53bf5f91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:46.560874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1dea486-ac19-4584-a5bd-4fb53bf5f91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:46.569573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1dea486-ac19-4584-a5bd-4fb53bf5f91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088048 May 26 13:12:46.570141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 682/1391] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:46 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:47.588749 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6067d2b2-6316-48b4-bd3e-06a7b8b417e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:47.589389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6067d2b2-6316-48b4-bd3e-06a7b8b417e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:47.597323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6067d2b2-6316-48b4-bd3e-06a7b8b417e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:47.598126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6067d2b2-6316-48b4-bd3e-06a7b8b417e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:47.599527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6067d2b2-6316-48b4-bd3e-06a7b8b417e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:47.600316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6067d2b2-6316-48b4-bd3e-06a7b8b417e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:47.673252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6067d2b2-6316-48b4-bd3e-06a7b8b417e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:47.681284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6067d2b2-6316-48b4-bd3e-06a7b8b417e9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.097214 May 26 13:12:47.681872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 710/1392] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:47 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:48.698415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-620098b3-8b2e-4157-893b-26aa3916e36d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:48.699664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-620098b3-8b2e-4157-893b-26aa3916e36d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:48.706126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-620098b3-8b2e-4157-893b-26aa3916e36d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:48.706610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-620098b3-8b2e-4157-893b-26aa3916e36d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:48.707395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-620098b3-8b2e-4157-893b-26aa3916e36d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:48.707825 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-620098b3-8b2e-4157-893b-26aa3916e36d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:48.771247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-620098b3-8b2e-4157-893b-26aa3916e36d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:48.779103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-620098b3-8b2e-4157-893b-26aa3916e36d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084572 May 26 13:12:48.779698 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 683/1393] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:48 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:49.796660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6b4a1b0e-441a-4df3-97b0-357eb4327427 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:49.797288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6b4a1b0e-441a-4df3-97b0-357eb4327427 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:49.803942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b4a1b0e-441a-4df3-97b0-357eb4327427 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:49.804379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b4a1b0e-441a-4df3-97b0-357eb4327427 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:49.805146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b4a1b0e-441a-4df3-97b0-357eb4327427 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:49.805576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b4a1b0e-441a-4df3-97b0-357eb4327427 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:49.868914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6b4a1b0e-441a-4df3-97b0-357eb4327427 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:49.877948 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6b4a1b0e-441a-4df3-97b0-357eb4327427 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085548 May 26 13:12:49.878453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 711/1394] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:49 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:50.898007 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-98c5fc24-068c-434a-8f4d-49200889cd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:50.898658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-98c5fc24-068c-434a-8f4d-49200889cd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:50.905814 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98c5fc24-068c-434a-8f4d-49200889cd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:50.906309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98c5fc24-068c-434a-8f4d-49200889cd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:50.907125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98c5fc24-068c-434a-8f4d-49200889cd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:50.907560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98c5fc24-068c-434a-8f4d-49200889cd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:50.967990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-98c5fc24-068c-434a-8f4d-49200889cd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:50.975563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-98c5fc24-068c-434a-8f4d-49200889cd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081427 May 26 13:12:50.976126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 684/1395] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:50 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:51.993186 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5bda5840-5405-4960-b6e7-052f04ec8fa3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:51.993801 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5bda5840-5405-4960-b6e7-052f04ec8fa3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:52.001180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bda5840-5405-4960-b6e7-052f04ec8fa3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:52.001632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bda5840-5405-4960-b6e7-052f04ec8fa3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:52.002401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bda5840-5405-4960-b6e7-052f04ec8fa3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:52.002870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bda5840-5405-4960-b6e7-052f04ec8fa3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:52.064397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5bda5840-5405-4960-b6e7-052f04ec8fa3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:52.072153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5bda5840-5405-4960-b6e7-052f04ec8fa3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082666 May 26 13:12:52.072713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 712/1396] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:51 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:53.088381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c63a4f34-eb8e-4f97-ac54-93a31424dc92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:53.088998 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c63a4f34-eb8e-4f97-ac54-93a31424dc92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:53.096880 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c63a4f34-eb8e-4f97-ac54-93a31424dc92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:53.097335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c63a4f34-eb8e-4f97-ac54-93a31424dc92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:53.098123 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c63a4f34-eb8e-4f97-ac54-93a31424dc92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:53.098596 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c63a4f34-eb8e-4f97-ac54-93a31424dc92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:53.160273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c63a4f34-eb8e-4f97-ac54-93a31424dc92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:53.168429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c63a4f34-eb8e-4f97-ac54-93a31424dc92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083276 May 26 13:12:53.168978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 685/1397] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:53 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:54.185389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c4dab561-f5ac-4a66-a714-0e888d490f62 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:54.185987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4dab561-f5ac-4a66-a714-0e888d490f62 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:54.188427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:12:54.193990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4dab561-f5ac-4a66-a714-0e888d490f62 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:54.194444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4dab561-f5ac-4a66-a714-0e888d490f62 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:54.195254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4dab561-f5ac-4a66-a714-0e888d490f62 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:54.195690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4dab561-f5ac-4a66-a714-0e888d490f62 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:54.271775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4dab561-f5ac-4a66-a714-0e888d490f62 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:54.283404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c4dab561-f5ac-4a66-a714-0e888d490f62 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.101598 May 26 13:12:54.288184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 713/1398] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:54 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:55.304835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc8a1e9f-ff56-4361-83e8-eef4387317c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:55.305490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc8a1e9f-ff56-4361-83e8-eef4387317c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:55.307830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:12:55.313208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc8a1e9f-ff56-4361-83e8-eef4387317c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:55.313656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc8a1e9f-ff56-4361-83e8-eef4387317c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:55.314437 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc8a1e9f-ff56-4361-83e8-eef4387317c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:55.314902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc8a1e9f-ff56-4361-83e8-eef4387317c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:55.390000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc8a1e9f-ff56-4361-83e8-eef4387317c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:55.397940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc8a1e9f-ff56-4361-83e8-eef4387317c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.096953 May 26 13:12:55.398620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 686/1399] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:55 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:56.416455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ed2eaf4-9afc-45ee-b15c-984b592ce7e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:56.417059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ed2eaf4-9afc-45ee-b15c-984b592ce7e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:56.423881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ed2eaf4-9afc-45ee-b15c-984b592ce7e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:56.428263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ed2eaf4-9afc-45ee-b15c-984b592ce7e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:56.428263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ed2eaf4-9afc-45ee-b15c-984b592ce7e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:56.428263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ed2eaf4-9afc-45ee-b15c-984b592ce7e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:56.436048 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:12:56.509039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ed2eaf4-9afc-45ee-b15c-984b592ce7e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:56.517854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ed2eaf4-9afc-45ee-b15c-984b592ce7e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.105898 May 26 13:12:56.518425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 714/1400] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:56 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:57.535739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7fd714c8-2348-4565-b583-98a129183a91 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:57.536343 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7fd714c8-2348-4565-b583-98a129183a91 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:57.543268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fd714c8-2348-4565-b583-98a129183a91 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:57.543796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fd714c8-2348-4565-b583-98a129183a91 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:57.544556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fd714c8-2348-4565-b583-98a129183a91 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:57.544992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fd714c8-2348-4565-b583-98a129183a91 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:57.547522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:12:57.615856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fd714c8-2348-4565-b583-98a129183a91 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:57.623937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7fd714c8-2348-4565-b583-98a129183a91 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092198 May 26 13:12:57.624498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 687/1401] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:57 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:58.640758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f21f243-6a13-4765-8f5d-69aadbff11eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:58.641441 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f21f243-6a13-4765-8f5d-69aadbff11eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:58.647559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f21f243-6a13-4765-8f5d-69aadbff11eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:58.648003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f21f243-6a13-4765-8f5d-69aadbff11eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:58.648763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f21f243-6a13-4765-8f5d-69aadbff11eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:58.649199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f21f243-6a13-4765-8f5d-69aadbff11eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:58.718632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f21f243-6a13-4765-8f5d-69aadbff11eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:58.726938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f21f243-6a13-4765-8f5d-69aadbff11eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090246 May 26 13:12:58.727506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 715/1402] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:58 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:12:59.744645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7b540500-0dba-4fd4-92ac-f2877c86b1d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:12:59.745224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7b540500-0dba-4fd4-92ac-f2877c86b1d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:12:59.751994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b540500-0dba-4fd4-92ac-f2877c86b1d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:59.752445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b540500-0dba-4fd4-92ac-f2877c86b1d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:59.753208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b540500-0dba-4fd4-92ac-f2877c86b1d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:12:59.753644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b540500-0dba-4fd4-92ac-f2877c86b1d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:12:59.814092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7b540500-0dba-4fd4-92ac-f2877c86b1d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:12:59.821964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7b540500-0dba-4fd4-92ac-f2877c86b1d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081082 May 26 13:12:59.822795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 688/1403] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:12:59 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:00.839712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c5e5588f-34d7-43b6-a39b-de0e19a5cac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:00.840423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c5e5588f-34d7-43b6-a39b-de0e19a5cac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:00.847431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5e5588f-34d7-43b6-a39b-de0e19a5cac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:00.847920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5e5588f-34d7-43b6-a39b-de0e19a5cac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:00.848709 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5e5588f-34d7-43b6-a39b-de0e19a5cac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:00.849148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5e5588f-34d7-43b6-a39b-de0e19a5cac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:00.911472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c5e5588f-34d7-43b6-a39b-de0e19a5cac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:00.919530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c5e5588f-34d7-43b6-a39b-de0e19a5cac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083813 May 26 13:13:00.920097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 716/1404] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:00 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:01.937114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc775f0b-da62-42b0-a15a-6f88af504476 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:01.937702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc775f0b-da62-42b0-a15a-6f88af504476 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:01.944333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc775f0b-da62-42b0-a15a-6f88af504476 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:01.944783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc775f0b-da62-42b0-a15a-6f88af504476 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:01.945546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc775f0b-da62-42b0-a15a-6f88af504476 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:01.945981 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc775f0b-da62-42b0-a15a-6f88af504476 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:02.009882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc775f0b-da62-42b0-a15a-6f88af504476 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:02.018203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc775f0b-da62-42b0-a15a-6f88af504476 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085812 May 26 13:13:02.018814 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 689/1405] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:01 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:03.035128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-169bedfd-b213-4fd4-b68e-0f6e310874c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:03.035762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-169bedfd-b213-4fd4-b68e-0f6e310874c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:03.043625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-169bedfd-b213-4fd4-b68e-0f6e310874c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:03.044324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-169bedfd-b213-4fd4-b68e-0f6e310874c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:03.045157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-169bedfd-b213-4fd4-b68e-0f6e310874c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:03.045604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-169bedfd-b213-4fd4-b68e-0f6e310874c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:03.114712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-169bedfd-b213-4fd4-b68e-0f6e310874c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:03.123044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-169bedfd-b213-4fd4-b68e-0f6e310874c9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091806 May 26 13:13:03.123614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 717/1406] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:03 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:04.139991 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-664a9c5a-1ea2-427e-bc0d-58b65469acac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:04.140587 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-664a9c5a-1ea2-427e-bc0d-58b65469acac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:04.147134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-664a9c5a-1ea2-427e-bc0d-58b65469acac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:04.147588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-664a9c5a-1ea2-427e-bc0d-58b65469acac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:04.148356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-664a9c5a-1ea2-427e-bc0d-58b65469acac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:04.148797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-664a9c5a-1ea2-427e-bc0d-58b65469acac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:04.209322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-664a9c5a-1ea2-427e-bc0d-58b65469acac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:04.217653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-664a9c5a-1ea2-427e-bc0d-58b65469acac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081791 May 26 13:13:04.218220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 690/1407] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:04 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:05.235524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-837d5475-9bd3-4915-b22f-f3c23099430f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:05.236344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-837d5475-9bd3-4915-b22f-f3c23099430f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:05.242554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-837d5475-9bd3-4915-b22f-f3c23099430f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:05.242993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-837d5475-9bd3-4915-b22f-f3c23099430f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:05.243745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-837d5475-9bd3-4915-b22f-f3c23099430f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:05.244181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-837d5475-9bd3-4915-b22f-f3c23099430f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:05.310238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-837d5475-9bd3-4915-b22f-f3c23099430f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:05.318413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-837d5475-9bd3-4915-b22f-f3c23099430f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087041 May 26 13:13:05.319017 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 718/1408] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:05 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:06.339632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab1422a0-1692-4bc8-aa6c-8b91179499bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:06.340239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab1422a0-1692-4bc8-aa6c-8b91179499bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:06.346900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab1422a0-1692-4bc8-aa6c-8b91179499bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:06.347354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab1422a0-1692-4bc8-aa6c-8b91179499bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:06.348125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab1422a0-1692-4bc8-aa6c-8b91179499bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:06.348559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab1422a0-1692-4bc8-aa6c-8b91179499bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:06.416145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ab1422a0-1692-4bc8-aa6c-8b91179499bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:06.424348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab1422a0-1692-4bc8-aa6c-8b91179499bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088408 May 26 13:13:06.425598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 691/1409] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:06 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:07.442501 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cd07ad72-329b-455b-a533-72708bb93144 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:07.443144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cd07ad72-329b-455b-a533-72708bb93144 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:07.450269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd07ad72-329b-455b-a533-72708bb93144 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:07.450763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd07ad72-329b-455b-a533-72708bb93144 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:07.451540 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd07ad72-329b-455b-a533-72708bb93144 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:07.451998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd07ad72-329b-455b-a533-72708bb93144 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:07.517809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cd07ad72-329b-455b-a533-72708bb93144 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:07.525556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cd07ad72-329b-455b-a533-72708bb93144 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086932 May 26 13:13:07.526129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 719/1410] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:07 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:13:08.543925 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f567418-a4b2-4b9b-a0ab-bc0eb1d17fac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:08.544613 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f567418-a4b2-4b9b-a0ab-bc0eb1d17fac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:08.551238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f567418-a4b2-4b9b-a0ab-bc0eb1d17fac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:08.551840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f567418-a4b2-4b9b-a0ab-bc0eb1d17fac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:08.552440 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f567418-a4b2-4b9b-a0ab-bc0eb1d17fac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:08.552880 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f567418-a4b2-4b9b-a0ab-bc0eb1d17fac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:08.621855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f567418-a4b2-4b9b-a0ab-bc0eb1d17fac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:08.629610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f567418-a4b2-4b9b-a0ab-bc0eb1d17fac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089788 May 26 13:13:08.630225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 692/1411] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:08 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:13:09.659927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-286fc3ef-b7ef-484d-b019-8cd4f0715e4b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:09.660687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-286fc3ef-b7ef-484d-b019-8cd4f0715e4b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:09.667316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-286fc3ef-b7ef-484d-b019-8cd4f0715e4b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:09.668364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-286fc3ef-b7ef-484d-b019-8cd4f0715e4b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:09.669161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-286fc3ef-b7ef-484d-b019-8cd4f0715e4b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:09.669602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-286fc3ef-b7ef-484d-b019-8cd4f0715e4b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:09.750385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-286fc3ef-b7ef-484d-b019-8cd4f0715e4b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:09.758727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-286fc3ef-b7ef-484d-b019-8cd4f0715e4b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.103947 May 26 13:13:09.759299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 720/1412] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:09 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:10.779681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2c5139bc-2596-4123-a280-5be68bcfa1d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:10.780578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2c5139bc-2596-4123-a280-5be68bcfa1d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:10.787041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c5139bc-2596-4123-a280-5be68bcfa1d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:10.787489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c5139bc-2596-4123-a280-5be68bcfa1d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:10.788254 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c5139bc-2596-4123-a280-5be68bcfa1d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:10.788735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c5139bc-2596-4123-a280-5be68bcfa1d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:10.854368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2c5139bc-2596-4123-a280-5be68bcfa1d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:10.863283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2c5139bc-2596-4123-a280-5be68bcfa1d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090136 May 26 13:13:10.863858 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 693/1413] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:10 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:11.879653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9038f6f9-44f7-493c-aa2a-ef397fa4324a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:11.880267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9038f6f9-44f7-493c-aa2a-ef397fa4324a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:11.887481 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9038f6f9-44f7-493c-aa2a-ef397fa4324a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:11.888059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9038f6f9-44f7-493c-aa2a-ef397fa4324a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:11.888933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9038f6f9-44f7-493c-aa2a-ef397fa4324a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:11.889467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9038f6f9-44f7-493c-aa2a-ef397fa4324a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:11.959108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9038f6f9-44f7-493c-aa2a-ef397fa4324a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:11.967616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9038f6f9-44f7-493c-aa2a-ef397fa4324a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091816 May 26 13:13:11.968191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 721/1414] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:11 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:12.984788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c93fcbe7-4c0b-4656-81cf-28feb327696c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:12.985624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c93fcbe7-4c0b-4656-81cf-28feb327696c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:12.992283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c93fcbe7-4c0b-4656-81cf-28feb327696c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:12.992746 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c93fcbe7-4c0b-4656-81cf-28feb327696c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:12.993523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c93fcbe7-4c0b-4656-81cf-28feb327696c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:12.993961 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c93fcbe7-4c0b-4656-81cf-28feb327696c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:13.060416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c93fcbe7-4c0b-4656-81cf-28feb327696c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:13.070794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c93fcbe7-4c0b-4656-81cf-28feb327696c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089998 May 26 13:13:13.071554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 694/1415] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:12 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:14.088630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-512e58b2-11ec-40f9-961f-552536bba0ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:14.089242 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-512e58b2-11ec-40f9-961f-552536bba0ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:14.096635 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-512e58b2-11ec-40f9-961f-552536bba0ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:14.097083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-512e58b2-11ec-40f9-961f-552536bba0ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:14.097975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-512e58b2-11ec-40f9-961f-552536bba0ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:14.098414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-512e58b2-11ec-40f9-961f-552536bba0ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:14.162095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-512e58b2-11ec-40f9-961f-552536bba0ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:14.169954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-512e58b2-11ec-40f9-961f-552536bba0ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085162 May 26 13:13:14.170540 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 722/1416] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:14 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:15.188049 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5cee0747-3067-49fa-a053-10bd3dd59f66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:15.188650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5cee0747-3067-49fa-a053-10bd3dd59f66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:15.199421 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cee0747-3067-49fa-a053-10bd3dd59f66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:15.199871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cee0747-3067-49fa-a053-10bd3dd59f66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:15.200652 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cee0747-3067-49fa-a053-10bd3dd59f66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:15.201096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cee0747-3067-49fa-a053-10bd3dd59f66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:15.269565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5cee0747-3067-49fa-a053-10bd3dd59f66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:15.280673 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5cee0747-3067-49fa-a053-10bd3dd59f66 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.096390 May 26 13:13:15.281279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 695/1417] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:15 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:16.299379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9e96439-764e-4535-9c87-e16c6d9b3131 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:16.299984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9e96439-764e-4535-9c87-e16c6d9b3131 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:16.307242 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9e96439-764e-4535-9c87-e16c6d9b3131 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:16.308377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9e96439-764e-4535-9c87-e16c6d9b3131 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:16.309304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9e96439-764e-4535-9c87-e16c6d9b3131 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:16.309875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9e96439-764e-4535-9c87-e16c6d9b3131 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:16.374951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9e96439-764e-4535-9c87-e16c6d9b3131 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:16.387888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9e96439-764e-4535-9c87-e16c6d9b3131 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.093577 May 26 13:13:16.388532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 723/1418] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:16 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:17.405153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd1066dd-a1c2-4a6d-ad83-a8c6ea7888d0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:17.406354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd1066dd-a1c2-4a6d-ad83-a8c6ea7888d0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:17.413235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd1066dd-a1c2-4a6d-ad83-a8c6ea7888d0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:17.413683 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd1066dd-a1c2-4a6d-ad83-a8c6ea7888d0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:17.414455 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd1066dd-a1c2-4a6d-ad83-a8c6ea7888d0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:17.414915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd1066dd-a1c2-4a6d-ad83-a8c6ea7888d0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:17.482872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd1066dd-a1c2-4a6d-ad83-a8c6ea7888d0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:17.490643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd1066dd-a1c2-4a6d-ad83-a8c6ea7888d0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089572 May 26 13:13:17.491307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 696/1419] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:17 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:18.509273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e3ff864-9508-4d98-a049-0fa6258a68c7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:18.509927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e3ff864-9508-4d98-a049-0fa6258a68c7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:18.517212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3ff864-9508-4d98-a049-0fa6258a68c7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:18.517662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3ff864-9508-4d98-a049-0fa6258a68c7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:18.518461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3ff864-9508-4d98-a049-0fa6258a68c7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:18.518898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3ff864-9508-4d98-a049-0fa6258a68c7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:18.586212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e3ff864-9508-4d98-a049-0fa6258a68c7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:18.594578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e3ff864-9508-4d98-a049-0fa6258a68c7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089236 May 26 13:13:18.595162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 724/1420] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:18 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:19.611260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a586a6b3-ca5d-49a7-8e08-893a1a1d8f5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:19.611804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a586a6b3-ca5d-49a7-8e08-893a1a1d8f5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:19.618470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a586a6b3-ca5d-49a7-8e08-893a1a1d8f5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:19.618967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a586a6b3-ca5d-49a7-8e08-893a1a1d8f5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:19.619788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a586a6b3-ca5d-49a7-8e08-893a1a1d8f5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:19.621380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a586a6b3-ca5d-49a7-8e08-893a1a1d8f5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:19.685298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a586a6b3-ca5d-49a7-8e08-893a1a1d8f5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:19.692914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a586a6b3-ca5d-49a7-8e08-893a1a1d8f5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085988 May 26 13:13:19.693472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 697/1421] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:19 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:20.710600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20901a89-c966-4553-a77f-9f3026de3d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:20.711249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-20901a89-c966-4553-a77f-9f3026de3d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:20.718626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20901a89-c966-4553-a77f-9f3026de3d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:20.719181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20901a89-c966-4553-a77f-9f3026de3d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:20.719948 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20901a89-c966-4553-a77f-9f3026de3d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:20.720382 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20901a89-c966-4553-a77f-9f3026de3d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:20.793790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20901a89-c966-4553-a77f-9f3026de3d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:20.801598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-20901a89-c966-4553-a77f-9f3026de3d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.094811 May 26 13:13:20.806621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 725/1422] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:20 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:21.818449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-adfe7e3d-fe98-4097-8813-4debccf59cc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:21.819092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-adfe7e3d-fe98-4097-8813-4debccf59cc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:21.825849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adfe7e3d-fe98-4097-8813-4debccf59cc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:21.826298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adfe7e3d-fe98-4097-8813-4debccf59cc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:21.827125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adfe7e3d-fe98-4097-8813-4debccf59cc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:21.827559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adfe7e3d-fe98-4097-8813-4debccf59cc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:21.890160 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-adfe7e3d-fe98-4097-8813-4debccf59cc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:21.897748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-adfe7e3d-fe98-4097-8813-4debccf59cc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083182 May 26 13:13:21.898435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 698/1423] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:21 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:22.915147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1108c34-3d24-44e9-8119-cda877a55e5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:22.915875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1108c34-3d24-44e9-8119-cda877a55e5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:22.922942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1108c34-3d24-44e9-8119-cda877a55e5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:22.923385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1108c34-3d24-44e9-8119-cda877a55e5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:22.924188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1108c34-3d24-44e9-8119-cda877a55e5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:22.924624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1108c34-3d24-44e9-8119-cda877a55e5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:23.036427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1108c34-3d24-44e9-8119-cda877a55e5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:23.045349 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1108c34-3d24-44e9-8119-cda877a55e5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.133858 May 26 13:13:23.045963 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 726/1424] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:22 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:24.063850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5220234c-0523-4253-b549-759a57d23ee5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:24.064464 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5220234c-0523-4253-b549-759a57d23ee5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:24.070450 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5220234c-0523-4253-b549-759a57d23ee5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:24.070925 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5220234c-0523-4253-b549-759a57d23ee5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:24.071682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5220234c-0523-4253-b549-759a57d23ee5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:24.072116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5220234c-0523-4253-b549-759a57d23ee5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:24.185617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5220234c-0523-4253-b549-759a57d23ee5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:24.193967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5220234c-0523-4253-b549-759a57d23ee5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.134044 May 26 13:13:24.194535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 699/1425] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:24 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:25.211638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d3201ad6-101e-445e-a516-e3bbd1782e22 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:25.212257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d3201ad6-101e-445e-a516-e3bbd1782e22 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:25.215247 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:25.220126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3201ad6-101e-445e-a516-e3bbd1782e22 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:25.220582 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3201ad6-101e-445e-a516-e3bbd1782e22 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:25.221350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3201ad6-101e-445e-a516-e3bbd1782e22 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:25.221788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3201ad6-101e-445e-a516-e3bbd1782e22 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:25.284750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3201ad6-101e-445e-a516-e3bbd1782e22 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:25.293103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d3201ad6-101e-445e-a516-e3bbd1782e22 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085283 May 26 13:13:25.293609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 727/1426] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:25 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:13:26.310129 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3abaedae-ada4-4bbb-b6b7-b8009a3a044f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:26.310771 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3abaedae-ada4-4bbb-b6b7-b8009a3a044f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:26.313244 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:26.318018 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3abaedae-ada4-4bbb-b6b7-b8009a3a044f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:26.325598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3abaedae-ada4-4bbb-b6b7-b8009a3a044f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:26.325598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3abaedae-ada4-4bbb-b6b7-b8009a3a044f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:26.325598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3abaedae-ada4-4bbb-b6b7-b8009a3a044f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:26.385144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3abaedae-ada4-4bbb-b6b7-b8009a3a044f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:26.392243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3abaedae-ada4-4bbb-b6b7-b8009a3a044f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086193 May 26 13:13:26.392825 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 700/1427] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:26 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:27.415808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-21725a29-26ee-499a-b4fe-2fd7a939a1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:27.417613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-21725a29-26ee-499a-b4fe-2fd7a939a1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:27.425225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21725a29-26ee-499a-b4fe-2fd7a939a1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:27.425704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21725a29-26ee-499a-b4fe-2fd7a939a1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:27.426475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21725a29-26ee-499a-b4fe-2fd7a939a1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:27.426946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21725a29-26ee-499a-b4fe-2fd7a939a1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:27.431838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:27.505688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-21725a29-26ee-499a-b4fe-2fd7a939a1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:27.514021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-21725a29-26ee-499a-b4fe-2fd7a939a1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.105906 May 26 13:13:27.514626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 728/1428] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:27 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:28.531422 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4d0bcd8-34e9-4a7f-aa6b-3f005e12d58d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:28.532011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a4d0bcd8-34e9-4a7f-aa6b-3f005e12d58d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:28.538662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4d0bcd8-34e9-4a7f-aa6b-3f005e12d58d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:28.539118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4d0bcd8-34e9-4a7f-aa6b-3f005e12d58d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:28.539891 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4d0bcd8-34e9-4a7f-aa6b-3f005e12d58d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:28.540329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4d0bcd8-34e9-4a7f-aa6b-3f005e12d58d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:28.544296 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:28.600843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a4d0bcd8-34e9-4a7f-aa6b-3f005e12d58d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:28.608820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4d0bcd8-34e9-4a7f-aa6b-3f005e12d58d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081362 May 26 13:13:28.609388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 701/1429] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:28 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:29.625434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9c880cc3-8aeb-488e-859f-28dcf0d0f562 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:29.626030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9c880cc3-8aeb-488e-859f-28dcf0d0f562 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:29.632488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c880cc3-8aeb-488e-859f-28dcf0d0f562 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:29.632943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c880cc3-8aeb-488e-859f-28dcf0d0f562 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:29.633702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c880cc3-8aeb-488e-859f-28dcf0d0f562 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:29.634206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c880cc3-8aeb-488e-859f-28dcf0d0f562 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:29.703531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c880cc3-8aeb-488e-859f-28dcf0d0f562 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:29.711317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9c880cc3-8aeb-488e-859f-28dcf0d0f562 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089693 May 26 13:13:29.711917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 729/1430] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:29 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:30.728740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7ad43a4-9a80-4ab4-a52d-a12b2f6e108f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:30.730184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7ad43a4-9a80-4ab4-a52d-a12b2f6e108f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:30.737706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7ad43a4-9a80-4ab4-a52d-a12b2f6e108f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:30.738161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7ad43a4-9a80-4ab4-a52d-a12b2f6e108f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:30.738964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7ad43a4-9a80-4ab4-a52d-a12b2f6e108f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:30.739402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7ad43a4-9a80-4ab4-a52d-a12b2f6e108f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:30.803128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7ad43a4-9a80-4ab4-a52d-a12b2f6e108f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:30.811803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7ad43a4-9a80-4ab4-a52d-a12b2f6e108f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086827 May 26 13:13:30.812397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 702/1431] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:30 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:31.829720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b18b4481-6b1a-42df-a261-007a9a597536 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:31.830473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b18b4481-6b1a-42df-a261-007a9a597536 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:31.837953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b18b4481-6b1a-42df-a261-007a9a597536 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:31.838407 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b18b4481-6b1a-42df-a261-007a9a597536 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:31.840354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b18b4481-6b1a-42df-a261-007a9a597536 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:31.840354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b18b4481-6b1a-42df-a261-007a9a597536 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:31.905347 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b18b4481-6b1a-42df-a261-007a9a597536 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:31.913318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b18b4481-6b1a-42df-a261-007a9a597536 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087594 May 26 13:13:31.913918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 730/1432] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:31 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:32.933227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd7472b5-eddc-4339-b703-6fb379729111 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:32.934149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd7472b5-eddc-4339-b703-6fb379729111 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:32.941184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd7472b5-eddc-4339-b703-6fb379729111 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:32.941665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd7472b5-eddc-4339-b703-6fb379729111 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:32.942453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd7472b5-eddc-4339-b703-6fb379729111 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:32.942946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd7472b5-eddc-4339-b703-6fb379729111 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:33.009784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd7472b5-eddc-4339-b703-6fb379729111 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:33.017485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd7472b5-eddc-4339-b703-6fb379729111 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089059 May 26 13:13:33.018587 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 703/1433] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:32 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:34.034471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66e2dda4-f383-4c6a-b887-32fc35ffd4cb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:34.035118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-66e2dda4-f383-4c6a-b887-32fc35ffd4cb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:34.041868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66e2dda4-f383-4c6a-b887-32fc35ffd4cb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:34.042575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66e2dda4-f383-4c6a-b887-32fc35ffd4cb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:34.043350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66e2dda4-f383-4c6a-b887-32fc35ffd4cb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:34.043789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66e2dda4-f383-4c6a-b887-32fc35ffd4cb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:34.108821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66e2dda4-f383-4c6a-b887-32fc35ffd4cb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:34.116470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-66e2dda4-f383-4c6a-b887-32fc35ffd4cb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086032 May 26 13:13:34.117418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 731/1434] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:34 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:35.134698 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5bdaca0-8199-4db5-9a20-562ae0ddd223 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:35.135475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d5bdaca0-8199-4db5-9a20-562ae0ddd223 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:35.142417 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5bdaca0-8199-4db5-9a20-562ae0ddd223 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:35.142900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5bdaca0-8199-4db5-9a20-562ae0ddd223 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:35.143687 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5bdaca0-8199-4db5-9a20-562ae0ddd223 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:35.144128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5bdaca0-8199-4db5-9a20-562ae0ddd223 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:35.210484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d5bdaca0-8199-4db5-9a20-562ae0ddd223 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:35.218767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d5bdaca0-8199-4db5-9a20-562ae0ddd223 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087978 May 26 13:13:35.219344 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 704/1435] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:35 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:36.236741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8157857f-a8a8-459e-ae6a-9854d46990d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:36.237596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8157857f-a8a8-459e-ae6a-9854d46990d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:36.244158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8157857f-a8a8-459e-ae6a-9854d46990d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:36.244655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8157857f-a8a8-459e-ae6a-9854d46990d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:36.245427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8157857f-a8a8-459e-ae6a-9854d46990d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:36.246009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8157857f-a8a8-459e-ae6a-9854d46990d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:36.308999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8157857f-a8a8-459e-ae6a-9854d46990d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:36.316557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8157857f-a8a8-459e-ae6a-9854d46990d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083673 May 26 13:13:36.317131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 732/1436] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:36 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:37.334812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c2b734c-1ec1-4a6b-9729-9ee2076a02f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:37.335427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c2b734c-1ec1-4a6b-9729-9ee2076a02f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:37.344646 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c2b734c-1ec1-4a6b-9729-9ee2076a02f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:37.345101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c2b734c-1ec1-4a6b-9729-9ee2076a02f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:37.346275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c2b734c-1ec1-4a6b-9729-9ee2076a02f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:37.346810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c2b734c-1ec1-4a6b-9729-9ee2076a02f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:37.420998 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c2b734c-1ec1-4a6b-9729-9ee2076a02f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:37.428177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c2b734c-1ec1-4a6b-9729-9ee2076a02f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.097490 May 26 13:13:37.428177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 705/1437] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:37 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:38.449177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea650cb7-f0c4-4bae-97be-b2d0df080a55 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:38.449862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea650cb7-f0c4-4bae-97be-b2d0df080a55 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:38.456498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea650cb7-f0c4-4bae-97be-b2d0df080a55 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:38.456956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea650cb7-f0c4-4bae-97be-b2d0df080a55 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:38.457720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea650cb7-f0c4-4bae-97be-b2d0df080a55 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:38.458162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea650cb7-f0c4-4bae-97be-b2d0df080a55 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:38.523274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ea650cb7-f0c4-4bae-97be-b2d0df080a55 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:38.531184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea650cb7-f0c4-4bae-97be-b2d0df080a55 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087071 May 26 13:13:38.537854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 733/1438] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:38 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:39.553392 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72c3ab44-3b9e-4e9d-a5db-f4e929bbf310 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:39.554004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72c3ab44-3b9e-4e9d-a5db-f4e929bbf310 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:39.561214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c3ab44-3b9e-4e9d-a5db-f4e929bbf310 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:39.561672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c3ab44-3b9e-4e9d-a5db-f4e929bbf310 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:39.562444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c3ab44-3b9e-4e9d-a5db-f4e929bbf310 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:39.562914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c3ab44-3b9e-4e9d-a5db-f4e929bbf310 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:39.624824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72c3ab44-3b9e-4e9d-a5db-f4e929bbf310 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:39.632283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72c3ab44-3b9e-4e9d-a5db-f4e929bbf310 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082907 May 26 13:13:39.632840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 706/1439] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:39 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:40.649190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7fc8620-2138-44c1-acb0-707500c17c0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:40.649821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7fc8620-2138-44c1-acb0-707500c17c0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:40.656992 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7fc8620-2138-44c1-acb0-707500c17c0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:40.657439 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7fc8620-2138-44c1-acb0-707500c17c0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:40.658200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7fc8620-2138-44c1-acb0-707500c17c0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:40.658664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7fc8620-2138-44c1-acb0-707500c17c0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:40.722645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7fc8620-2138-44c1-acb0-707500c17c0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:40.730904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7fc8620-2138-44c1-acb0-707500c17c0e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085498 May 26 13:13:40.731471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 734/1440] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:40 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:41.748010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-191bf1fe-039d-443f-a1c4-2e38638ab01a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:41.748651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-191bf1fe-039d-443f-a1c4-2e38638ab01a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:41.755318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-191bf1fe-039d-443f-a1c4-2e38638ab01a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:41.755795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-191bf1fe-039d-443f-a1c4-2e38638ab01a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:41.756583 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-191bf1fe-039d-443f-a1c4-2e38638ab01a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:41.757102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-191bf1fe-039d-443f-a1c4-2e38638ab01a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:41.820914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-191bf1fe-039d-443f-a1c4-2e38638ab01a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:41.832035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-191bf1fe-039d-443f-a1c4-2e38638ab01a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088076 May 26 13:13:41.832610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 707/1441] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:41 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:42.849975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-445c38c3-ee37-45a3-9417-e25169c7e962 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:42.850568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-445c38c3-ee37-45a3-9417-e25169c7e962 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:42.860431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-445c38c3-ee37-45a3-9417-e25169c7e962 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:42.860888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-445c38c3-ee37-45a3-9417-e25169c7e962 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:42.861682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-445c38c3-ee37-45a3-9417-e25169c7e962 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:42.862124 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-445c38c3-ee37-45a3-9417-e25169c7e962 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:42.938550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-445c38c3-ee37-45a3-9417-e25169c7e962 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:42.946196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-445c38c3-ee37-45a3-9417-e25169c7e962 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.100204 May 26 13:13:42.946789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 735/1442] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:42 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:43.963839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2fdc8b6-2106-478a-963a-67502981ea44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:43.964442 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2fdc8b6-2106-478a-963a-67502981ea44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:43.971792 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2fdc8b6-2106-478a-963a-67502981ea44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:43.972242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2fdc8b6-2106-478a-963a-67502981ea44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:43.973000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2fdc8b6-2106-478a-963a-67502981ea44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:43.973439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2fdc8b6-2106-478a-963a-67502981ea44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:44.035099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2fdc8b6-2106-478a-963a-67502981ea44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:44.042822 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2fdc8b6-2106-478a-963a-67502981ea44 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082938 May 26 13:13:44.043387 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 708/1443] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:43 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:45.060813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4026dfbc-1e94-406a-9abf-09b6c55fd6a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:45.062072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4026dfbc-1e94-406a-9abf-09b6c55fd6a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:45.068980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4026dfbc-1e94-406a-9abf-09b6c55fd6a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:45.069429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4026dfbc-1e94-406a-9abf-09b6c55fd6a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:45.070190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4026dfbc-1e94-406a-9abf-09b6c55fd6a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:45.070654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4026dfbc-1e94-406a-9abf-09b6c55fd6a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:45.134151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4026dfbc-1e94-406a-9abf-09b6c55fd6a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:45.141760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4026dfbc-1e94-406a-9abf-09b6c55fd6a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084843 May 26 13:13:45.142328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 736/1444] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:45 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:46.159038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-484b3068-2bde-48e0-92fa-656d4ca86a34 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:46.159710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-484b3068-2bde-48e0-92fa-656d4ca86a34 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:46.166347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484b3068-2bde-48e0-92fa-656d4ca86a34 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:46.166829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484b3068-2bde-48e0-92fa-656d4ca86a34 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:46.167605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484b3068-2bde-48e0-92fa-656d4ca86a34 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:46.168113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484b3068-2bde-48e0-92fa-656d4ca86a34 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:46.232384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-484b3068-2bde-48e0-92fa-656d4ca86a34 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:46.240266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-484b3068-2bde-48e0-92fa-656d4ca86a34 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085451 May 26 13:13:46.240834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 709/1445] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:46 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:47.256897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89dc5e12-594c-4147-99f5-8b9c6f2a314b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:47.257605 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-89dc5e12-594c-4147-99f5-8b9c6f2a314b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:47.264098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89dc5e12-594c-4147-99f5-8b9c6f2a314b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:47.265206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89dc5e12-594c-4147-99f5-8b9c6f2a314b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:47.265355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89dc5e12-594c-4147-99f5-8b9c6f2a314b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:47.265767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89dc5e12-594c-4147-99f5-8b9c6f2a314b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:47.331275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-89dc5e12-594c-4147-99f5-8b9c6f2a314b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:47.339659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-89dc5e12-594c-4147-99f5-8b9c6f2a314b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086259 May 26 13:13:47.340240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 737/1446] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:47 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:48.358373 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-626177b2-d9c3-4f82-a7fe-ed4f198b93f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:48.358997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-626177b2-d9c3-4f82-a7fe-ed4f198b93f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:48.366260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-626177b2-d9c3-4f82-a7fe-ed4f198b93f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:48.366747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-626177b2-d9c3-4f82-a7fe-ed4f198b93f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:48.367518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-626177b2-d9c3-4f82-a7fe-ed4f198b93f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:48.368020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-626177b2-d9c3-4f82-a7fe-ed4f198b93f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:48.431789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-626177b2-d9c3-4f82-a7fe-ed4f198b93f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:48.439892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-626177b2-d9c3-4f82-a7fe-ed4f198b93f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086048 May 26 13:13:48.440503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 710/1447] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:48 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:49.457383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fbee0b16-2b9f-4d19-946c-e9a2b90e81d5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:49.458007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fbee0b16-2b9f-4d19-946c-e9a2b90e81d5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:49.465230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbee0b16-2b9f-4d19-946c-e9a2b90e81d5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:49.465701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbee0b16-2b9f-4d19-946c-e9a2b90e81d5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:49.466466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbee0b16-2b9f-4d19-946c-e9a2b90e81d5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:49.466938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbee0b16-2b9f-4d19-946c-e9a2b90e81d5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:49.530602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fbee0b16-2b9f-4d19-946c-e9a2b90e81d5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:49.538759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fbee0b16-2b9f-4d19-946c-e9a2b90e81d5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085165 May 26 13:13:49.539265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 738/1448] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:49 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:50.555558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3221197-2846-4991-a718-5d2b3d6be3ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:50.556106 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3221197-2846-4991-a718-5d2b3d6be3ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:50.562725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3221197-2846-4991-a718-5d2b3d6be3ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:50.563183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3221197-2846-4991-a718-5d2b3d6be3ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:50.563948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3221197-2846-4991-a718-5d2b3d6be3ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:50.564389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3221197-2846-4991-a718-5d2b3d6be3ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:50.629262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b3221197-2846-4991-a718-5d2b3d6be3ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:50.637292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3221197-2846-4991-a718-5d2b3d6be3ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085659 May 26 13:13:50.637866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 711/1449] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:50 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:51.654147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e7a1e48-104d-4963-9bc5-6feb0bcab771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:51.654790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e7a1e48-104d-4963-9bc5-6feb0bcab771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:51.661482 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e7a1e48-104d-4963-9bc5-6feb0bcab771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:51.661927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e7a1e48-104d-4963-9bc5-6feb0bcab771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:51.662752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e7a1e48-104d-4963-9bc5-6feb0bcab771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:51.663200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e7a1e48-104d-4963-9bc5-6feb0bcab771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:51.724896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e7a1e48-104d-4963-9bc5-6feb0bcab771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:51.733460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e7a1e48-104d-4963-9bc5-6feb0bcab771 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083129 May 26 13:13:51.734065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 739/1450] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:51 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:52.751654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2231cac8-1943-4a9a-bac9-2bba1ccad105 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:52.752282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2231cac8-1943-4a9a-bac9-2bba1ccad105 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:52.758241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2231cac8-1943-4a9a-bac9-2bba1ccad105 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:52.759320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2231cac8-1943-4a9a-bac9-2bba1ccad105 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:52.760242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2231cac8-1943-4a9a-bac9-2bba1ccad105 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:52.760688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2231cac8-1943-4a9a-bac9-2bba1ccad105 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:52.820535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2231cac8-1943-4a9a-bac9-2bba1ccad105 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:52.828947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2231cac8-1943-4a9a-bac9-2bba1ccad105 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082031 May 26 13:13:52.829523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 712/1451] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:52 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:53.849086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f90c4de3-35c6-408b-9d61-4ab7a40918b8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:53.849763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f90c4de3-35c6-408b-9d61-4ab7a40918b8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:53.856402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f90c4de3-35c6-408b-9d61-4ab7a40918b8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:53.857104 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f90c4de3-35c6-408b-9d61-4ab7a40918b8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:53.857867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f90c4de3-35c6-408b-9d61-4ab7a40918b8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:53.858302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f90c4de3-35c6-408b-9d61-4ab7a40918b8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:53.920004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f90c4de3-35c6-408b-9d61-4ab7a40918b8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:53.927747 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f90c4de3-35c6-408b-9d61-4ab7a40918b8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083344 May 26 13:13:53.928368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 740/1452] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:53 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:13:54.944767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-39788d0b-c0a8-4b70-8be7-0603750f8a7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:54.945392 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-39788d0b-c0a8-4b70-8be7-0603750f8a7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:54.951493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39788d0b-c0a8-4b70-8be7-0603750f8a7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:54.951941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39788d0b-c0a8-4b70-8be7-0603750f8a7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:54.952698 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39788d0b-c0a8-4b70-8be7-0603750f8a7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:54.953156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39788d0b-c0a8-4b70-8be7-0603750f8a7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:55.014504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-39788d0b-c0a8-4b70-8be7-0603750f8a7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:55.022094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-39788d0b-c0a8-4b70-8be7-0603750f8a7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081324 May 26 13:13:55.022668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 713/1453] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:54 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:56.039930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-88150cf4-2787-4fda-b9c3-5fcfae654cbf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:56.040543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-88150cf4-2787-4fda-b9c3-5fcfae654cbf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:56.042875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:56.048399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88150cf4-2787-4fda-b9c3-5fcfae654cbf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:56.048852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88150cf4-2787-4fda-b9c3-5fcfae654cbf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:56.049651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88150cf4-2787-4fda-b9c3-5fcfae654cbf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:56.050236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88150cf4-2787-4fda-b9c3-5fcfae654cbf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:56.120840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-88150cf4-2787-4fda-b9c3-5fcfae654cbf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:56.129453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-88150cf4-2787-4fda-b9c3-5fcfae654cbf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.093428 May 26 13:13:56.130077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 741/1454] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:56 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:57.148336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f6e8fee-675e-40ab-94b3-77601115e4aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:57.148950 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f6e8fee-675e-40ab-94b3-77601115e4aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:57.151243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:57.157031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f6e8fee-675e-40ab-94b3-77601115e4aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:57.162462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f6e8fee-675e-40ab-94b3-77601115e4aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:57.162462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f6e8fee-675e-40ab-94b3-77601115e4aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:57.162462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f6e8fee-675e-40ab-94b3-77601115e4aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:57.220506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2f6e8fee-675e-40ab-94b3-77601115e4aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:57.227929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f6e8fee-675e-40ab-94b3-77601115e4aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083450 May 26 13:13:57.228518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 714/1455] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:57 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:58.245076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d07ca1e-27ac-4693-b60f-cd523b392364 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:58.245628 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d07ca1e-27ac-4693-b60f-cd523b392364 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:58.253169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d07ca1e-27ac-4693-b60f-cd523b392364 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:58.253653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d07ca1e-27ac-4693-b60f-cd523b392364 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:58.254414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d07ca1e-27ac-4693-b60f-cd523b392364 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:58.254882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d07ca1e-27ac-4693-b60f-cd523b392364 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:58.258915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:58.317607 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d07ca1e-27ac-4693-b60f-cd523b392364 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:58.325159 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d07ca1e-27ac-4693-b60f-cd523b392364 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084065 May 26 13:13:58.325786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 742/1456] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:58 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:13:59.341778 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb881c55-839d-4e8d-a5e4-c7fa943f2615 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:13:59.342562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb881c55-839d-4e8d-a5e4-c7fa943f2615 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:13:59.349143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb881c55-839d-4e8d-a5e4-c7fa943f2615 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:59.349595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb881c55-839d-4e8d-a5e4-c7fa943f2615 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:59.350361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb881c55-839d-4e8d-a5e4-c7fa943f2615 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:13:59.350826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb881c55-839d-4e8d-a5e4-c7fa943f2615 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:13:59.353335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:59.415509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb881c55-839d-4e8d-a5e4-c7fa943f2615 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:13:59.424313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb881c55-839d-4e8d-a5e4-c7fa943f2615 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086390 May 26 13:13:59.424899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 715/1457] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:13:59 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:00.441379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fb24026f-04d1-4744-b8b0-cb08c0f6ab80 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:00.441990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fb24026f-04d1-4744-b8b0-cb08c0f6ab80 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:00.448508 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb24026f-04d1-4744-b8b0-cb08c0f6ab80 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:00.448962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb24026f-04d1-4744-b8b0-cb08c0f6ab80 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:00.449732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb24026f-04d1-4744-b8b0-cb08c0f6ab80 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:00.450179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb24026f-04d1-4744-b8b0-cb08c0f6ab80 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:00.512380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb24026f-04d1-4744-b8b0-cb08c0f6ab80 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:00.521112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fb24026f-04d1-4744-b8b0-cb08c0f6ab80 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083640 May 26 13:14:00.521778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 743/1458] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:00 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:01.540015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-79c719cf-aa7e-4f7a-a44b-19a95fdf4d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:01.540566 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-79c719cf-aa7e-4f7a-a44b-19a95fdf4d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:01.547906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79c719cf-aa7e-4f7a-a44b-19a95fdf4d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:01.548368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79c719cf-aa7e-4f7a-a44b-19a95fdf4d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:01.549143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79c719cf-aa7e-4f7a-a44b-19a95fdf4d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:01.549586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79c719cf-aa7e-4f7a-a44b-19a95fdf4d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:01.618475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-79c719cf-aa7e-4f7a-a44b-19a95fdf4d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:01.626276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-79c719cf-aa7e-4f7a-a44b-19a95fdf4d42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090257 May 26 13:14:01.631813 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 716/1459] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:01 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:02.643059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-224ae2ce-efb8-4cb1-b08f-a55de5b4ad0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:02.643692 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-224ae2ce-efb8-4cb1-b08f-a55de5b4ad0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:02.650365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-224ae2ce-efb8-4cb1-b08f-a55de5b4ad0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:02.650843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-224ae2ce-efb8-4cb1-b08f-a55de5b4ad0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:02.651608 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-224ae2ce-efb8-4cb1-b08f-a55de5b4ad0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:02.652042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-224ae2ce-efb8-4cb1-b08f-a55de5b4ad0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:02.713944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-224ae2ce-efb8-4cb1-b08f-a55de5b4ad0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:02.721691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-224ae2ce-efb8-4cb1-b08f-a55de5b4ad0f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082438 May 26 13:14:02.722248 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 744/1460] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:02 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:03.738850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-712c318b-2c10-41c0-8c1f-6bde0e6e4e67 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:03.739448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-712c318b-2c10-41c0-8c1f-6bde0e6e4e67 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:03.746206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-712c318b-2c10-41c0-8c1f-6bde0e6e4e67 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:03.746808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-712c318b-2c10-41c0-8c1f-6bde0e6e4e67 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:03.747578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-712c318b-2c10-41c0-8c1f-6bde0e6e4e67 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:03.748014 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-712c318b-2c10-41c0-8c1f-6bde0e6e4e67 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:03.808736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-712c318b-2c10-41c0-8c1f-6bde0e6e4e67 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:03.816488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-712c318b-2c10-41c0-8c1f-6bde0e6e4e67 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082159 May 26 13:14:03.817043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 717/1461] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:03 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:04.833337 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-07bea550-359a-494c-a09b-b35e4b832ff3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:04.833935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-07bea550-359a-494c-a09b-b35e4b832ff3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:04.840525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07bea550-359a-494c-a09b-b35e4b832ff3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:04.840971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07bea550-359a-494c-a09b-b35e4b832ff3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:04.841726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07bea550-359a-494c-a09b-b35e4b832ff3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:04.842157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07bea550-359a-494c-a09b-b35e4b832ff3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:04.906499 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07bea550-359a-494c-a09b-b35e4b832ff3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:04.914271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-07bea550-359a-494c-a09b-b35e4b832ff3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085065 May 26 13:14:04.914868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 745/1462] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:04 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:05.931538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a488cc6-6e57-4189-922a-958907bbd93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:05.932136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a488cc6-6e57-4189-922a-958907bbd93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:05.939343 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a488cc6-6e57-4189-922a-958907bbd93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:05.939796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a488cc6-6e57-4189-922a-958907bbd93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:05.940653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a488cc6-6e57-4189-922a-958907bbd93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:05.941090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a488cc6-6e57-4189-922a-958907bbd93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:06.000815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a488cc6-6e57-4189-922a-958907bbd93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:06.009024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a488cc6-6e57-4189-922a-958907bbd93a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081334 May 26 13:14:06.009584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 718/1463] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:05 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:07.027369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3705bfd9-4c2b-4ced-b1b4-8a159d35dce2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:07.028099 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3705bfd9-4c2b-4ced-b1b4-8a159d35dce2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:07.035296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3705bfd9-4c2b-4ced-b1b4-8a159d35dce2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:07.035742 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3705bfd9-4c2b-4ced-b1b4-8a159d35dce2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:07.036499 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3705bfd9-4c2b-4ced-b1b4-8a159d35dce2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:07.036935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3705bfd9-4c2b-4ced-b1b4-8a159d35dce2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:07.100095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3705bfd9-4c2b-4ced-b1b4-8a159d35dce2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:07.107867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3705bfd9-4c2b-4ced-b1b4-8a159d35dce2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084456 May 26 13:14:07.108438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 746/1464] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:07 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:08.124815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a81afd55-deff-475f-bb0e-537d27d225f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:08.125459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a81afd55-deff-475f-bb0e-537d27d225f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:08.132154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a81afd55-deff-475f-bb0e-537d27d225f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:08.132603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a81afd55-deff-475f-bb0e-537d27d225f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:08.133374 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a81afd55-deff-475f-bb0e-537d27d225f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:08.133847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a81afd55-deff-475f-bb0e-537d27d225f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:08.200811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a81afd55-deff-475f-bb0e-537d27d225f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:08.209714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a81afd55-deff-475f-bb0e-537d27d225f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088549 May 26 13:14:08.212825 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 719/1465] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:08 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:09.226704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d95e94f-d772-4f50-ac46-88f9191792ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:09.227569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d95e94f-d772-4f50-ac46-88f9191792ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:09.234315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d95e94f-d772-4f50-ac46-88f9191792ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:09.234813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d95e94f-d772-4f50-ac46-88f9191792ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:09.236143 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d95e94f-d772-4f50-ac46-88f9191792ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:09.236592 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d95e94f-d772-4f50-ac46-88f9191792ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:09.309693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d95e94f-d772-4f50-ac46-88f9191792ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:09.318142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d95e94f-d772-4f50-ac46-88f9191792ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.095345 May 26 13:14:09.327973 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 747/1466] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:09 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:10.344605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-68251a91-dfe7-477d-b20b-ba409425ebbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:10.345435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-68251a91-dfe7-477d-b20b-ba409425ebbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:10.352304 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68251a91-dfe7-477d-b20b-ba409425ebbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:10.352759 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68251a91-dfe7-477d-b20b-ba409425ebbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:10.353530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68251a91-dfe7-477d-b20b-ba409425ebbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:10.353968 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68251a91-dfe7-477d-b20b-ba409425ebbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:10.417110 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-68251a91-dfe7-477d-b20b-ba409425ebbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:10.425192 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-68251a91-dfe7-477d-b20b-ba409425ebbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084466 May 26 13:14:10.425774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 720/1467] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:10 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:11.442135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5060ecd8-bc21-4907-8c3d-cf519fc609e7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:11.442796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5060ecd8-bc21-4907-8c3d-cf519fc609e7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:11.449560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5060ecd8-bc21-4907-8c3d-cf519fc609e7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:11.450016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5060ecd8-bc21-4907-8c3d-cf519fc609e7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:11.450827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5060ecd8-bc21-4907-8c3d-cf519fc609e7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:11.451267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5060ecd8-bc21-4907-8c3d-cf519fc609e7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:11.529108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5060ecd8-bc21-4907-8c3d-cf519fc609e7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:11.541524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5060ecd8-bc21-4907-8c3d-cf519fc609e7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.103361 May 26 13:14:11.542229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 748/1468] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:11 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:12.563034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0b09fde4-2557-4e24-857b-22d8aa8f0d5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:12.563785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b09fde4-2557-4e24-857b-22d8aa8f0d5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:12.571808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b09fde4-2557-4e24-857b-22d8aa8f0d5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:12.572271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b09fde4-2557-4e24-857b-22d8aa8f0d5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:12.573423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b09fde4-2557-4e24-857b-22d8aa8f0d5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:12.573976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b09fde4-2557-4e24-857b-22d8aa8f0d5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:12.642370 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b09fde4-2557-4e24-857b-22d8aa8f0d5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:12.650127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0b09fde4-2557-4e24-857b-22d8aa8f0d5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091207 May 26 13:14:12.650805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 721/1469] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:12 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:13.667148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee30a057-b412-4954-b7c0-4ef277d59867 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:13.667757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee30a057-b412-4954-b7c0-4ef277d59867 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:13.675584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee30a057-b412-4954-b7c0-4ef277d59867 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:13.676142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee30a057-b412-4954-b7c0-4ef277d59867 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:13.676922 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee30a057-b412-4954-b7c0-4ef277d59867 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:13.677363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee30a057-b412-4954-b7c0-4ef277d59867 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:13.743959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee30a057-b412-4954-b7c0-4ef277d59867 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:13.752361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee30a057-b412-4954-b7c0-4ef277d59867 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089048 May 26 13:14:13.753089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 749/1470] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:13 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:14.770594 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca9aa934-fd08-42db-ad69-b214b6f076ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:14.771269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ca9aa934-fd08-42db-ad69-b214b6f076ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:14.777997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca9aa934-fd08-42db-ad69-b214b6f076ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:14.778448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca9aa934-fd08-42db-ad69-b214b6f076ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:14.779243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca9aa934-fd08-42db-ad69-b214b6f076ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:14.779689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca9aa934-fd08-42db-ad69-b214b6f076ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:14.842042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ca9aa934-fd08-42db-ad69-b214b6f076ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:14.850289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ca9aa934-fd08-42db-ad69-b214b6f076ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084296 May 26 13:14:14.850914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 722/1471] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:14 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:15.868790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2980fac7-fff0-431c-851a-4e0bb45cab9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:15.869435 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2980fac7-fff0-431c-851a-4e0bb45cab9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:15.876300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2980fac7-fff0-431c-851a-4e0bb45cab9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:15.876752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2980fac7-fff0-431c-851a-4e0bb45cab9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:15.878086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2980fac7-fff0-431c-851a-4e0bb45cab9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:15.878519 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2980fac7-fff0-431c-851a-4e0bb45cab9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:15.943580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2980fac7-fff0-431c-851a-4e0bb45cab9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:15.951289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2980fac7-fff0-431c-851a-4e0bb45cab9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086364 May 26 13:14:15.951861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 750/1472] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:15 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:16.969423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04022913-cf6d-426a-8c0d-8cacea609f04 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:16.970027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04022913-cf6d-426a-8c0d-8cacea609f04 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:16.977116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04022913-cf6d-426a-8c0d-8cacea609f04 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:16.977567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04022913-cf6d-426a-8c0d-8cacea609f04 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:16.978341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04022913-cf6d-426a-8c0d-8cacea609f04 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:16.978801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04022913-cf6d-426a-8c0d-8cacea609f04 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:17.048489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04022913-cf6d-426a-8c0d-8cacea609f04 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:17.058504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04022913-cf6d-426a-8c0d-8cacea609f04 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092916 May 26 13:14:17.059122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 723/1473] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:16 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:18.076052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e0c5f7c-da36-4b02-b617-016bdd9dbc90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:18.076637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e0c5f7c-da36-4b02-b617-016bdd9dbc90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:18.083979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f7c-da36-4b02-b617-016bdd9dbc90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:18.084437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f7c-da36-4b02-b617-016bdd9dbc90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:18.085223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f7c-da36-4b02-b617-016bdd9dbc90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:18.085670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f7c-da36-4b02-b617-016bdd9dbc90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:18.154562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9e0c5f7c-da36-4b02-b617-016bdd9dbc90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:18.162995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e0c5f7c-da36-4b02-b617-016bdd9dbc90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090848 May 26 13:14:18.163578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 751/1474] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:18 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:19.180069 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcbb41eb-9bc5-4ed3-b474-d79fd381f96d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:19.180763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dcbb41eb-9bc5-4ed3-b474-d79fd381f96d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:19.187875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcbb41eb-9bc5-4ed3-b474-d79fd381f96d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:19.188328 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcbb41eb-9bc5-4ed3-b474-d79fd381f96d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:19.189096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcbb41eb-9bc5-4ed3-b474-d79fd381f96d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:19.189531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcbb41eb-9bc5-4ed3-b474-d79fd381f96d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:19.257134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcbb41eb-9bc5-4ed3-b474-d79fd381f96d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:19.269212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcbb41eb-9bc5-4ed3-b474-d79fd381f96d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092913 May 26 13:14:19.270357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 724/1475] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:19 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:20.293150 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cc2fedaf-b4ec-4a48-aa4f-91d039f13655 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:20.293786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cc2fedaf-b4ec-4a48-aa4f-91d039f13655 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:20.301146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc2fedaf-b4ec-4a48-aa4f-91d039f13655 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:20.301146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc2fedaf-b4ec-4a48-aa4f-91d039f13655 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:20.302199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc2fedaf-b4ec-4a48-aa4f-91d039f13655 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:20.302662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc2fedaf-b4ec-4a48-aa4f-91d039f13655 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:20.366863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cc2fedaf-b4ec-4a48-aa4f-91d039f13655 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:20.374297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cc2fedaf-b4ec-4a48-aa4f-91d039f13655 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084965 May 26 13:14:20.374898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 752/1476] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:20 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:21.391578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c05fb1bc-8bb2-4251-ad12-fa8473820080 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:21.392196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c05fb1bc-8bb2-4251-ad12-fa8473820080 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:21.399758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05fb1bc-8bb2-4251-ad12-fa8473820080 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:21.400214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05fb1bc-8bb2-4251-ad12-fa8473820080 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:21.400992 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05fb1bc-8bb2-4251-ad12-fa8473820080 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:21.401434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05fb1bc-8bb2-4251-ad12-fa8473820080 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:21.465230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c05fb1bc-8bb2-4251-ad12-fa8473820080 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:21.473725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c05fb1bc-8bb2-4251-ad12-fa8473820080 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085870 May 26 13:14:21.474308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 725/1477] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:21 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:22.491390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef2c90d6-0267-4e81-9db5-1914c5ee48af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:22.492016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef2c90d6-0267-4e81-9db5-1914c5ee48af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:22.498030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2c90d6-0267-4e81-9db5-1914c5ee48af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:22.498482 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2c90d6-0267-4e81-9db5-1914c5ee48af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:22.499283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2c90d6-0267-4e81-9db5-1914c5ee48af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:22.499723 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2c90d6-0267-4e81-9db5-1914c5ee48af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:22.573806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef2c90d6-0267-4e81-9db5-1914c5ee48af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:22.581672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef2c90d6-0267-4e81-9db5-1914c5ee48af tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.094634 May 26 13:14:22.582101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 753/1478] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:22 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:23.599722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcb2531b-bf90-4f42-beeb-8f8b8a17a002 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:23.600296 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dcb2531b-bf90-4f42-beeb-8f8b8a17a002 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:23.606574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcb2531b-bf90-4f42-beeb-8f8b8a17a002 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:23.607068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcb2531b-bf90-4f42-beeb-8f8b8a17a002 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:23.607838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcb2531b-bf90-4f42-beeb-8f8b8a17a002 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:23.608273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcb2531b-bf90-4f42-beeb-8f8b8a17a002 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:23.669820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcb2531b-bf90-4f42-beeb-8f8b8a17a002 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:23.677472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcb2531b-bf90-4f42-beeb-8f8b8a17a002 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082591 May 26 13:14:23.678206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 726/1479] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:23 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:24.694805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f921f603-8cc2-4337-b0c0-d7a4a06f8ae9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:24.695623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f921f603-8cc2-4337-b0c0-d7a4a06f8ae9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:24.702326 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f921f603-8cc2-4337-b0c0-d7a4a06f8ae9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:24.702816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f921f603-8cc2-4337-b0c0-d7a4a06f8ae9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:24.703599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f921f603-8cc2-4337-b0c0-d7a4a06f8ae9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:24.704672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f921f603-8cc2-4337-b0c0-d7a4a06f8ae9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:24.765730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f921f603-8cc2-4337-b0c0-d7a4a06f8ae9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:24.774288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f921f603-8cc2-4337-b0c0-d7a4a06f8ae9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.083972 May 26 13:14:24.774893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 754/1480] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:24 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:25.789396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:14:25.790084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:14:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:14:25.792395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-44e438ce-47c3-4f38-aa19-a3d10785222d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:25.793775 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-44e438ce-47c3-4f38-aa19-a3d10785222d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:25.802253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44e438ce-47c3-4f38-aa19-a3d10785222d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:25.802754 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44e438ce-47c3-4f38-aa19-a3d10785222d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:25.803546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44e438ce-47c3-4f38-aa19-a3d10785222d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:25.803990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44e438ce-47c3-4f38-aa19-a3d10785222d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:25.869828 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-44e438ce-47c3-4f38-aa19-a3d10785222d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:25.877649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-44e438ce-47c3-4f38-aa19-a3d10785222d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090346 May 26 13:14:25.878972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 727/1481] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:25 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:26.896935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bad15d56-46ed-4059-99b8-232f2bdf146f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:26.897666 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bad15d56-46ed-4059-99b8-232f2bdf146f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:26.906777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:14:26.912385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad15d56-46ed-4059-99b8-232f2bdf146f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:26.912837 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad15d56-46ed-4059-99b8-232f2bdf146f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:26.913624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad15d56-46ed-4059-99b8-232f2bdf146f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:26.914064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad15d56-46ed-4059-99b8-232f2bdf146f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:26.987152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bad15d56-46ed-4059-99b8-232f2bdf146f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:26.995450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bad15d56-46ed-4059-99b8-232f2bdf146f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.103401 May 26 13:14:26.996016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 755/1482] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:26 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:28.013156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f000b4ff-015d-40b4-9ade-dd127888b845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:28.013772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f000b4ff-015d-40b4-9ade-dd127888b845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:28.016109 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:14:28.021213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f000b4ff-015d-40b4-9ade-dd127888b845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:28.021666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f000b4ff-015d-40b4-9ade-dd127888b845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:28.022447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f000b4ff-015d-40b4-9ade-dd127888b845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:28.022923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f000b4ff-015d-40b4-9ade-dd127888b845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:28.083426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f000b4ff-015d-40b4-9ade-dd127888b845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:28.090893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f000b4ff-015d-40b4-9ade-dd127888b845 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081640 May 26 13:14:28.091466 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 728/1483] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:28 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:29.108391 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fd41e94-1800-467f-9c75-fac34e34086a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:29.108975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fd41e94-1800-467f-9c75-fac34e34086a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:29.115297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fd41e94-1800-467f-9c75-fac34e34086a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:29.115746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fd41e94-1800-467f-9c75-fac34e34086a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:29.116504 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fd41e94-1800-467f-9c75-fac34e34086a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:29.116936 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fd41e94-1800-467f-9c75-fac34e34086a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:29.120769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:14:29.177295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fd41e94-1800-467f-9c75-fac34e34086a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:29.184714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fd41e94-1800-467f-9c75-fac34e34086a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.080483 May 26 13:14:29.185271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 756/1484] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:29 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:30.202941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2a31142-922e-4e5c-862f-aa8b0c6e35f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:30.203533 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2a31142-922e-4e5c-862f-aa8b0c6e35f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:30.210666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2a31142-922e-4e5c-862f-aa8b0c6e35f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:30.211117 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2a31142-922e-4e5c-862f-aa8b0c6e35f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:30.211881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2a31142-922e-4e5c-862f-aa8b0c6e35f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:30.212318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2a31142-922e-4e5c-862f-aa8b0c6e35f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:30.214835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:14:30.273814 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2a31142-922e-4e5c-862f-aa8b0c6e35f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:30.293386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2a31142-922e-4e5c-862f-aa8b0c6e35f8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.094073 May 26 13:14:30.293989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 729/1485] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:30 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:31.310841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4d287c24-e5e4-432d-b84a-397351d93068 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:31.311486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4d287c24-e5e4-432d-b84a-397351d93068 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:31.318673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d287c24-e5e4-432d-b84a-397351d93068 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:31.319135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d287c24-e5e4-432d-b84a-397351d93068 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:31.319912 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d287c24-e5e4-432d-b84a-397351d93068 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:31.320356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d287c24-e5e4-432d-b84a-397351d93068 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:31.384671 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4d287c24-e5e4-432d-b84a-397351d93068 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:31.392169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4d287c24-e5e4-432d-b84a-397351d93068 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085315 May 26 13:14:31.392735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 757/1486] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:31 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:32.410716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-82c0125d-a714-40b1-a7b6-9f173ca82eb9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:32.411361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-82c0125d-a714-40b1-a7b6-9f173ca82eb9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:32.418397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c0125d-a714-40b1-a7b6-9f173ca82eb9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:32.418889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c0125d-a714-40b1-a7b6-9f173ca82eb9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:32.419685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c0125d-a714-40b1-a7b6-9f173ca82eb9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:32.420130 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c0125d-a714-40b1-a7b6-9f173ca82eb9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:32.487677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82c0125d-a714-40b1-a7b6-9f173ca82eb9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:32.495618 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-82c0125d-a714-40b1-a7b6-9f173ca82eb9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088976 May 26 13:14:32.496189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 730/1487] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:32 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:33.513120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f0b3f7f-fe6a-47ad-8460-ddd06253cee2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:33.513775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5f0b3f7f-fe6a-47ad-8460-ddd06253cee2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:33.522981 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f0b3f7f-fe6a-47ad-8460-ddd06253cee2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:33.526744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f0b3f7f-fe6a-47ad-8460-ddd06253cee2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:33.527722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f0b3f7f-fe6a-47ad-8460-ddd06253cee2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:33.528262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f0b3f7f-fe6a-47ad-8460-ddd06253cee2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:33.592181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5f0b3f7f-fe6a-47ad-8460-ddd06253cee2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:33.600181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f0b3f7f-fe6a-47ad-8460-ddd06253cee2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090892 May 26 13:14:33.600813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 758/1488] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:33 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:34.617504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b0d57d7-f464-40c9-82e1-ed6a31e0e350 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:34.618074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b0d57d7-f464-40c9-82e1-ed6a31e0e350 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:34.624754 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b0d57d7-f464-40c9-82e1-ed6a31e0e350 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:34.625208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b0d57d7-f464-40c9-82e1-ed6a31e0e350 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:34.625982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b0d57d7-f464-40c9-82e1-ed6a31e0e350 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:34.626414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b0d57d7-f464-40c9-82e1-ed6a31e0e350 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:34.693930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b0d57d7-f464-40c9-82e1-ed6a31e0e350 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:34.701492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b0d57d7-f464-40c9-82e1-ed6a31e0e350 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088966 May 26 13:14:34.702056 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 731/1489] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:34 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:35.719084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b7e42bf9-80a7-401c-93fd-e176e163578d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:35.719666 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b7e42bf9-80a7-401c-93fd-e176e163578d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:35.726546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7e42bf9-80a7-401c-93fd-e176e163578d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:35.726999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7e42bf9-80a7-401c-93fd-e176e163578d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:35.727756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7e42bf9-80a7-401c-93fd-e176e163578d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:35.728191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7e42bf9-80a7-401c-93fd-e176e163578d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:35.792216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b7e42bf9-80a7-401c-93fd-e176e163578d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:35.804200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b7e42bf9-80a7-401c-93fd-e176e163578d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088553 May 26 13:14:35.805254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 759/1490] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:35 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:36.821287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ae30345-2c0d-4e4e-9fd9-43b2aef109c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:36.821933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ae30345-2c0d-4e4e-9fd9-43b2aef109c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:36.828670 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae30345-2c0d-4e4e-9fd9-43b2aef109c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:36.829243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae30345-2c0d-4e4e-9fd9-43b2aef109c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:36.830041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae30345-2c0d-4e4e-9fd9-43b2aef109c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:36.830484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae30345-2c0d-4e4e-9fd9-43b2aef109c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:36.897180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ae30345-2c0d-4e4e-9fd9-43b2aef109c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:36.904712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ae30345-2c0d-4e4e-9fd9-43b2aef109c8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087296 May 26 13:14:36.905275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 732/1491] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:36 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:37.921338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-267cd67f-0251-4056-b5d4-da78e3e72339 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:37.921964 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-267cd67f-0251-4056-b5d4-da78e3e72339 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:37.930069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-267cd67f-0251-4056-b5d4-da78e3e72339 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:37.930553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-267cd67f-0251-4056-b5d4-da78e3e72339 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:37.931317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-267cd67f-0251-4056-b5d4-da78e3e72339 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:37.931807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-267cd67f-0251-4056-b5d4-da78e3e72339 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:37.998367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-267cd67f-0251-4056-b5d4-da78e3e72339 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:38.007686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-267cd67f-0251-4056-b5d4-da78e3e72339 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090202 May 26 13:14:38.008264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 760/1492] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:37 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:39.030641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b913b212-283d-46a4-bb10-360a5078ca35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:39.031271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b913b212-283d-46a4-bb10-360a5078ca35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:39.037607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b913b212-283d-46a4-bb10-360a5078ca35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:39.038714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b913b212-283d-46a4-bb10-360a5078ca35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:39.039810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b913b212-283d-46a4-bb10-360a5078ca35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:39.040263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b913b212-283d-46a4-bb10-360a5078ca35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:39.105555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b913b212-283d-46a4-bb10-360a5078ca35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:39.113339 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b913b212-283d-46a4-bb10-360a5078ca35 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087319 May 26 13:14:39.113916 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 733/1493] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:39 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:40.130782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ff38a29-0a04-488d-b7d0-60434b487381 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:40.131387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ff38a29-0a04-488d-b7d0-60434b487381 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:40.137854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ff38a29-0a04-488d-b7d0-60434b487381 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:40.138300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ff38a29-0a04-488d-b7d0-60434b487381 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:40.139218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ff38a29-0a04-488d-b7d0-60434b487381 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:40.139655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ff38a29-0a04-488d-b7d0-60434b487381 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:40.206283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ff38a29-0a04-488d-b7d0-60434b487381 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:40.214003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ff38a29-0a04-488d-b7d0-60434b487381 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087596 May 26 13:14:40.214580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 761/1494] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:40 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:41.229948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0a0501fe-fd06-4847-b0a1-343631ed0a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:41.230586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0a0501fe-fd06-4847-b0a1-343631ed0a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:41.237379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a0501fe-fd06-4847-b0a1-343631ed0a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:41.237834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a0501fe-fd06-4847-b0a1-343631ed0a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:41.238638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a0501fe-fd06-4847-b0a1-343631ed0a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:41.239154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a0501fe-fd06-4847-b0a1-343631ed0a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:41.300806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0a0501fe-fd06-4847-b0a1-343631ed0a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:41.308548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0a0501fe-fd06-4847-b0a1-343631ed0a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.082588 May 26 13:14:41.309107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 734/1495] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:41 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:42.325675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a9a28d5-52c6-4a1a-9554-da2f7fe054b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:42.326277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a9a28d5-52c6-4a1a-9554-da2f7fe054b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:42.333219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a9a28d5-52c6-4a1a-9554-da2f7fe054b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:42.333766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a9a28d5-52c6-4a1a-9554-da2f7fe054b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:42.334651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a9a28d5-52c6-4a1a-9554-da2f7fe054b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:42.335088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a9a28d5-52c6-4a1a-9554-da2f7fe054b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:42.413007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a9a28d5-52c6-4a1a-9554-da2f7fe054b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:42.420557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a9a28d5-52c6-4a1a-9554-da2f7fe054b2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.098709 May 26 13:14:42.421145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 762/1496] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:42 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:43.403047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:14:43.403769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:14:43.437306 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-355ad5f0-cf9e-45ae-b67c-a8cf7dab3f56 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:43.437954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-355ad5f0-cf9e-45ae-b67c-a8cf7dab3f56 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:43.444986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-355ad5f0-cf9e-45ae-b67c-a8cf7dab3f56 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:43.445434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-355ad5f0-cf9e-45ae-b67c-a8cf7dab3f56 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:43.446196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-355ad5f0-cf9e-45ae-b67c-a8cf7dab3f56 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:43.446663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-355ad5f0-cf9e-45ae-b67c-a8cf7dab3f56 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:43.510876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-355ad5f0-cf9e-45ae-b67c-a8cf7dab3f56 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:43.518559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-355ad5f0-cf9e-45ae-b67c-a8cf7dab3f56 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085097 May 26 13:14:43.519154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 735/1497] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:43 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:44.543198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f377ddf3-7d96-4be6-a1be-7417d524c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:44.543759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f377ddf3-7d96-4be6-a1be-7417d524c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:44.550234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f377ddf3-7d96-4be6-a1be-7417d524c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:44.550714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f377ddf3-7d96-4be6-a1be-7417d524c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:44.552025 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f377ddf3-7d96-4be6-a1be-7417d524c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:44.552464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f377ddf3-7d96-4be6-a1be-7417d524c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:44.616761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f377ddf3-7d96-4be6-a1be-7417d524c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:44.624566 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f377ddf3-7d96-4be6-a1be-7417d524c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085301 May 26 13:14:44.625131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 763/1498] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:44 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:45.642215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3cebdf6f-96ac-45bc-b57e-9bba210d01f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:45.642857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3cebdf6f-96ac-45bc-b57e-9bba210d01f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:45.649837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3cebdf6f-96ac-45bc-b57e-9bba210d01f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:45.650293 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3cebdf6f-96ac-45bc-b57e-9bba210d01f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:45.651095 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3cebdf6f-96ac-45bc-b57e-9bba210d01f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:45.651537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3cebdf6f-96ac-45bc-b57e-9bba210d01f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:45.712761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3cebdf6f-96ac-45bc-b57e-9bba210d01f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:45.720162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3cebdf6f-96ac-45bc-b57e-9bba210d01f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.081827 May 26 13:14:45.720739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 736/1499] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:45 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:46.737674 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50c1d6d8-c95f-4e9d-a406-baf6c65bef7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:46.738275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50c1d6d8-c95f-4e9d-a406-baf6c65bef7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:46.745363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50c1d6d8-c95f-4e9d-a406-baf6c65bef7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:46.745811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50c1d6d8-c95f-4e9d-a406-baf6c65bef7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:46.746590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50c1d6d8-c95f-4e9d-a406-baf6c65bef7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:46.747031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50c1d6d8-c95f-4e9d-a406-baf6c65bef7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:46.817524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50c1d6d8-c95f-4e9d-a406-baf6c65bef7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:46.826184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50c1d6d8-c95f-4e9d-a406-baf6c65bef7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092245 May 26 13:14:46.826785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 764/1500] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:46 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:47.845766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f12f6d16-7aa3-4e18-b108-3719714131ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:47.846438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f12f6d16-7aa3-4e18-b108-3719714131ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:47.854377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f12f6d16-7aa3-4e18-b108-3719714131ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:47.854895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f12f6d16-7aa3-4e18-b108-3719714131ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:47.855947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f12f6d16-7aa3-4e18-b108-3719714131ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:47.856379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f12f6d16-7aa3-4e18-b108-3719714131ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:47.921085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f12f6d16-7aa3-4e18-b108-3719714131ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:47.928812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f12f6d16-7aa3-4e18-b108-3719714131ff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086843 May 26 13:14:47.929384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 737/1501] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:47 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:48.945987 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dac5d1e5-54f1-40e7-848c-0619ae0f69fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:48.946626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dac5d1e5-54f1-40e7-848c-0619ae0f69fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:48.953372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dac5d1e5-54f1-40e7-848c-0619ae0f69fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:48.953826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dac5d1e5-54f1-40e7-848c-0619ae0f69fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:48.954620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dac5d1e5-54f1-40e7-848c-0619ae0f69fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:48.955062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dac5d1e5-54f1-40e7-848c-0619ae0f69fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:49.019800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dac5d1e5-54f1-40e7-848c-0619ae0f69fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:49.027890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dac5d1e5-54f1-40e7-848c-0619ae0f69fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086303 May 26 13:14:49.028459 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 765/1502] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:48 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:50.047651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af1dac42-80df-4d8e-b94d-7f159de64a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:50.048381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-af1dac42-80df-4d8e-b94d-7f159de64a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:50.055015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af1dac42-80df-4d8e-b94d-7f159de64a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:50.055503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af1dac42-80df-4d8e-b94d-7f159de64a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:50.056289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af1dac42-80df-4d8e-b94d-7f159de64a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:50.056740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af1dac42-80df-4d8e-b94d-7f159de64a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:50.128656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af1dac42-80df-4d8e-b94d-7f159de64a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:50.138436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af1dac42-80df-4d8e-b94d-7f159de64a06 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.096182 May 26 13:14:50.139349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 738/1503] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:50 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:51.159863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fe004d75-aa2b-4a82-8e4a-585de62256d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:51.160759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fe004d75-aa2b-4a82-8e4a-585de62256d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:51.171265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe004d75-aa2b-4a82-8e4a-585de62256d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:51.171726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe004d75-aa2b-4a82-8e4a-585de62256d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:51.172756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe004d75-aa2b-4a82-8e4a-585de62256d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:51.173205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe004d75-aa2b-4a82-8e4a-585de62256d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:51.240229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe004d75-aa2b-4a82-8e4a-585de62256d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:51.247627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fe004d75-aa2b-4a82-8e4a-585de62256d6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.093160 May 26 13:14:51.248235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 766/1504] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:51 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:52.265561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31e43c40-7277-441c-aaf5-d46e8c22fac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:52.266184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31e43c40-7277-441c-aaf5-d46e8c22fac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:52.273759 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e43c40-7277-441c-aaf5-d46e8c22fac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:52.274208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e43c40-7277-441c-aaf5-d46e8c22fac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:52.275016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e43c40-7277-441c-aaf5-d46e8c22fac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:52.275444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e43c40-7277-441c-aaf5-d46e8c22fac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:52.347667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31e43c40-7277-441c-aaf5-d46e8c22fac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:52.357411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31e43c40-7277-441c-aaf5-d46e8c22fac3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.095647 May 26 13:14:52.358017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 739/1505] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:52 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:53.258213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:14:53.258434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:14:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:14:53.375742 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2a7d8e0e-136b-49dc-b5db-de1c2061be70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:53.376597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2a7d8e0e-136b-49dc-b5db-de1c2061be70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:53.384324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a7d8e0e-136b-49dc-b5db-de1c2061be70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:53.384783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a7d8e0e-136b-49dc-b5db-de1c2061be70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:53.385588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a7d8e0e-136b-49dc-b5db-de1c2061be70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:53.386031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a7d8e0e-136b-49dc-b5db-de1c2061be70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:53.459204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2a7d8e0e-136b-49dc-b5db-de1c2061be70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:53.479824 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2a7d8e0e-136b-49dc-b5db-de1c2061be70 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.107929 May 26 13:14:53.480424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 767/1506] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:53 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:14:54.499692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0a23b255-bf69-4910-a626-37da270b6cc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:54.500309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0a23b255-bf69-4910-a626-37da270b6cc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:54.507861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a23b255-bf69-4910-a626-37da270b6cc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:54.508319 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a23b255-bf69-4910-a626-37da270b6cc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:54.509116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a23b255-bf69-4910-a626-37da270b6cc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:54.509564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a23b255-bf69-4910-a626-37da270b6cc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:54.580626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0a23b255-bf69-4910-a626-37da270b6cc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:54.593231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0a23b255-bf69-4910-a626-37da270b6cc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.097336 May 26 13:14:54.594115 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 740/1507] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:54 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:14:55.617718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-43ee985c-4252-48e2-895d-abf96d564d94 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:55.618341 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-43ee985c-4252-48e2-895d-abf96d564d94 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:55.625322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43ee985c-4252-48e2-895d-abf96d564d94 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:55.626042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43ee985c-4252-48e2-895d-abf96d564d94 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:55.627357 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43ee985c-4252-48e2-895d-abf96d564d94 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:55.628057 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43ee985c-4252-48e2-895d-abf96d564d94 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:55.696698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-43ee985c-4252-48e2-895d-abf96d564d94 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:55.704539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-43ee985c-4252-48e2-895d-abf96d564d94 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.091257 May 26 13:14:55.705106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 768/1508] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:55 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:56.721176 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbd1bb82-40b6-4cd3-94b3-b5a086c476e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:56.721786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbd1bb82-40b6-4cd3-94b3-b5a086c476e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:56.729055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbd1bb82-40b6-4cd3-94b3-b5a086c476e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:56.729503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbd1bb82-40b6-4cd3-94b3-b5a086c476e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:56.730271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbd1bb82-40b6-4cd3-94b3-b5a086c476e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:56.731003 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbd1bb82-40b6-4cd3-94b3-b5a086c476e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:56.797403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbd1bb82-40b6-4cd3-94b3-b5a086c476e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:56.810308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbd1bb82-40b6-4cd3-94b3-b5a086c476e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.092544 May 26 13:14:56.811336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 741/1509] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:56 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:57.832395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4a00b8e3-73b7-4d71-ac15-736ea46c6c16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:57.833674 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a00b8e3-73b7-4d71-ac15-736ea46c6c16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:57.837138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:14:57.841993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a00b8e3-73b7-4d71-ac15-736ea46c6c16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:57.842439 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a00b8e3-73b7-4d71-ac15-736ea46c6c16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:57.843230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a00b8e3-73b7-4d71-ac15-736ea46c6c16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:57.843662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a00b8e3-73b7-4d71-ac15-736ea46c6c16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:57.913870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4a00b8e3-73b7-4d71-ac15-736ea46c6c16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:57.921522 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4a00b8e3-73b7-4d71-ac15-736ea46c6c16 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.096502 May 26 13:14:57.922162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 769/1510] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:57 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:14:58.938537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-df3424d6-df66-4471-8143-8d8720cd983d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:14:58.939180 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-df3424d6-df66-4471-8143-8d8720cd983d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:14:58.941583 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:14:58.947144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df3424d6-df66-4471-8143-8d8720cd983d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:58.947600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df3424d6-df66-4471-8143-8d8720cd983d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:58.948382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df3424d6-df66-4471-8143-8d8720cd983d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:14:58.948816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df3424d6-df66-4471-8143-8d8720cd983d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:14:59.012503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-df3424d6-df66-4471-8143-8d8720cd983d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:14:59.020120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-df3424d6-df66-4471-8143-8d8720cd983d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085568 May 26 13:14:59.020875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 742/1511] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:14:58 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:00.037485 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8736608-77a4-4284-ac80-e689c835be20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:00.038128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8736608-77a4-4284-ac80-e689c835be20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:00.044584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8736608-77a4-4284-ac80-e689c835be20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:00.045164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8736608-77a4-4284-ac80-e689c835be20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:00.045944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8736608-77a4-4284-ac80-e689c835be20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:00.046390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8736608-77a4-4284-ac80-e689c835be20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:00.050339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:15:00.111513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f8736608-77a4-4284-ac80-e689c835be20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:00.121081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8736608-77a4-4284-ac80-e689c835be20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087934 May 26 13:15:00.121643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 770/1512] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:00 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:01.138014 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c774313-124d-4045-885e-7bf80d60d024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:01.138656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c774313-124d-4045-885e-7bf80d60d024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:01.149313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c774313-124d-4045-885e-7bf80d60d024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:01.149769 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c774313-124d-4045-885e-7bf80d60d024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:01.150576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c774313-124d-4045-885e-7bf80d60d024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:01.151025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c774313-124d-4045-885e-7bf80d60d024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:01.153702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:15:01.216344 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c774313-124d-4045-885e-7bf80d60d024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:01.224605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c774313-124d-4045-885e-7bf80d60d024 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.090528 May 26 13:15:01.225170 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 743/1513] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:01 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:02.242011 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12a4944a-c9c5-4be6-ab26-c117ab8e89f9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:02.242636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12a4944a-c9c5-4be6-ab26-c117ab8e89f9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:02.249221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12a4944a-c9c5-4be6-ab26-c117ab8e89f9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:02.249661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12a4944a-c9c5-4be6-ab26-c117ab8e89f9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:02.250431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12a4944a-c9c5-4be6-ab26-c117ab8e89f9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:02.250897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12a4944a-c9c5-4be6-ab26-c117ab8e89f9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:02.314378 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12a4944a-c9c5-4be6-ab26-c117ab8e89f9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:02.322868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12a4944a-c9c5-4be6-ab26-c117ab8e89f9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084817 May 26 13:15:02.323491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 771/1514] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:02 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:03.340137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a9d2006-c13c-48a4-868d-8fb1a5c2ea02 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:03.340777 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a9d2006-c13c-48a4-868d-8fb1a5c2ea02 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:03.347420 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a9d2006-c13c-48a4-868d-8fb1a5c2ea02 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:03.347868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a9d2006-c13c-48a4-868d-8fb1a5c2ea02 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:03.349675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a9d2006-c13c-48a4-868d-8fb1a5c2ea02 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:03.350122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a9d2006-c13c-48a4-868d-8fb1a5c2ea02 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:03.414482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a9d2006-c13c-48a4-868d-8fb1a5c2ea02 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:03.422077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a9d2006-c13c-48a4-868d-8fb1a5c2ea02 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085865 May 26 13:15:03.422673 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 744/1515] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:03 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:04.439078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-647c496d-f204-4f38-84f4-d4ac82d48185 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:04.439740 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-647c496d-f204-4f38-84f4-d4ac82d48185 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:04.447432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-647c496d-f204-4f38-84f4-d4ac82d48185 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:04.447879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-647c496d-f204-4f38-84f4-d4ac82d48185 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:04.448708 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-647c496d-f204-4f38-84f4-d4ac82d48185 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:04.449148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-647c496d-f204-4f38-84f4-d4ac82d48185 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:04.513106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-647c496d-f204-4f38-84f4-d4ac82d48185 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:04.521528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-647c496d-f204-4f38-84f4-d4ac82d48185 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086325 May 26 13:15:04.522094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 772/1516] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:04 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:05.546099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9b707f61-dace-4be9-9087-555c7c8b1bf6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:05.547182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9b707f61-dace-4be9-9087-555c7c8b1bf6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:05.558064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b707f61-dace-4be9-9087-555c7c8b1bf6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:05.558516 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b707f61-dace-4be9-9087-555c7c8b1bf6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:05.559401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b707f61-dace-4be9-9087-555c7c8b1bf6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:05.559846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b707f61-dace-4be9-9087-555c7c8b1bf6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:05.786266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b707f61-dace-4be9-9087-555c7c8b1bf6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:05.794420 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9b707f61-dace-4be9-9087-555c7c8b1bf6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.255356 May 26 13:15:05.794711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 745/1517] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:05 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:06.813219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37eb012e-7228-4241-adc9-e155e622be08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:06.814002 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37eb012e-7228-4241-adc9-e155e622be08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:06.823206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37eb012e-7228-4241-adc9-e155e622be08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:06.823654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37eb012e-7228-4241-adc9-e155e622be08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:06.824424 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37eb012e-7228-4241-adc9-e155e622be08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:06.824862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37eb012e-7228-4241-adc9-e155e622be08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:06.891730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37eb012e-7228-4241-adc9-e155e622be08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:06.901146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37eb012e-7228-4241-adc9-e155e622be08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.093639 May 26 13:15:06.901713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 773/1518] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:06 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:07.922141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd6fac8d-78c0-4ba1-b079-b4518fc17764 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:07.922831 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd6fac8d-78c0-4ba1-b079-b4518fc17764 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:07.930406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd6fac8d-78c0-4ba1-b079-b4518fc17764 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:07.930891 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd6fac8d-78c0-4ba1-b079-b4518fc17764 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:07.931672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd6fac8d-78c0-4ba1-b079-b4518fc17764 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:07.932124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd6fac8d-78c0-4ba1-b079-b4518fc17764 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:07.996393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd6fac8d-78c0-4ba1-b079-b4518fc17764 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:08.004270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd6fac8d-78c0-4ba1-b079-b4518fc17764 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.086603 May 26 13:15:08.004907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 746/1519] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:07 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:15:09.022000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c46657ad-d39b-4ed7-b4c9-c9f4bc4cc650 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:09.022899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c46657ad-d39b-4ed7-b4c9-c9f4bc4cc650 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:09.029376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c46657ad-d39b-4ed7-b4c9-c9f4bc4cc650 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:09.029872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c46657ad-d39b-4ed7-b4c9-c9f4bc4cc650 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:09.030684 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c46657ad-d39b-4ed7-b4c9-c9f4bc4cc650 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:09.031133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c46657ad-d39b-4ed7-b4c9-c9f4bc4cc650 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:09.093727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c46657ad-d39b-4ed7-b4c9-c9f4bc4cc650 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:09.102316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c46657ad-d39b-4ed7-b4c9-c9f4bc4cc650 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084184 May 26 13:15:09.103046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 774/1520] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:09 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:10.119959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-40c93713-b1f7-4ef6-99b1-e9a3aa20328c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:10.120549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-40c93713-b1f7-4ef6-99b1-e9a3aa20328c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:10.127276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40c93713-b1f7-4ef6-99b1-e9a3aa20328c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:10.127728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40c93713-b1f7-4ef6-99b1-e9a3aa20328c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:10.128518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40c93713-b1f7-4ef6-99b1-e9a3aa20328c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:10.128954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40c93713-b1f7-4ef6-99b1-e9a3aa20328c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:10.193432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40c93713-b1f7-4ef6-99b1-e9a3aa20328c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:10.200938 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-40c93713-b1f7-4ef6-99b1-e9a3aa20328c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.085057 May 26 13:15:10.201494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 747/1521] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:10 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:11.218962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61211c8c-f396-4790-b071-8c426f1a4354 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:11.219616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61211c8c-f396-4790-b071-8c426f1a4354 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:11.226719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61211c8c-f396-4790-b071-8c426f1a4354 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:11.227171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61211c8c-f396-4790-b071-8c426f1a4354 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:11.227932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61211c8c-f396-4790-b071-8c426f1a4354 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:11.228367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61211c8c-f396-4790-b071-8c426f1a4354 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:11.295419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-61211c8c-f396-4790-b071-8c426f1a4354 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:11.303785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-61211c8c-f396-4790-b071-8c426f1a4354 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.088810 May 26 13:15:11.304293 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 775/1522] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:11 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:12.320505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9c4f81b8-1dcd-4434-a01f-dd7fce796b81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:12.321193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9c4f81b8-1dcd-4434-a01f-dd7fce796b81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:12.327699 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c4f81b8-1dcd-4434-a01f-dd7fce796b81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:12.328165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c4f81b8-1dcd-4434-a01f-dd7fce796b81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:12.328948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c4f81b8-1dcd-4434-a01f-dd7fce796b81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:12.329387 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c4f81b8-1dcd-4434-a01f-dd7fce796b81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:12.396815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c4f81b8-1dcd-4434-a01f-dd7fce796b81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:12.405434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9c4f81b8-1dcd-4434-a01f-dd7fce796b81 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.089027 May 26 13:15:12.406061 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 748/1523] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:12 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:13.353817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:15:13.354610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:15:13.424049 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aa591c99-3ec2-463a-aee0-0378ff86c057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:13.425068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aa591c99-3ec2-463a-aee0-0378ff86c057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:13.432374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa591c99-3ec2-463a-aee0-0378ff86c057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:13.432823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa591c99-3ec2-463a-aee0-0378ff86c057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:13.433606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa591c99-3ec2-463a-aee0-0378ff86c057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:13.434037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa591c99-3ec2-463a-aee0-0378ff86c057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:13.498238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa591c99-3ec2-463a-aee0-0378ff86c057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:13.506682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aa591c99-3ec2-463a-aee0-0378ff86c057 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087297 May 26 13:15:13.507258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 776/1524] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:13 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:14.524094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-30cc8d59-c213-44a2-8015-b9746a09c270 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:14.524693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-30cc8d59-c213-44a2-8015-b9746a09c270 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:14.531483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30cc8d59-c213-44a2-8015-b9746a09c270 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:14.531932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30cc8d59-c213-44a2-8015-b9746a09c270 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:14.532709 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30cc8d59-c213-44a2-8015-b9746a09c270 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:14.533149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30cc8d59-c213-44a2-8015-b9746a09c270 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:14.599903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-30cc8d59-c213-44a2-8015-b9746a09c270 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:14.607847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-30cc8d59-c213-44a2-8015-b9746a09c270 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.087758 May 26 13:15:14.608408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 749/1525] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:14 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:15.625137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b250123a-abe3-4a01-be34-b6d7396553b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:15.625767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b250123a-abe3-4a01-be34-b6d7396553b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:15.633337 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b250123a-abe3-4a01-be34-b6d7396553b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:15.633789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b250123a-abe3-4a01-be34-b6d7396553b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:15.634598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b250123a-abe3-4a01-be34-b6d7396553b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:15.635052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b250123a-abe3-4a01-be34-b6d7396553b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:15.715876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b250123a-abe3-4a01-be34-b6d7396553b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:15.723588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b250123a-abe3-4a01-be34-b6d7396553b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.102353 May 26 13:15:15.724156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 777/1526] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:15 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:16.741944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7ff88154-f6f3-4ffc-a008-503b17149a42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:16.742643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7ff88154-f6f3-4ffc-a008-503b17149a42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: cf382a59-333a-43e5-9760-6a443183cc3f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:16.749676 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7ff88154-f6f3-4ffc-a008-503b17149a42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:16.750172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7ff88154-f6f3-4ffc-a008-503b17149a42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:16.750994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7ff88154-f6f3-4ffc-a008-503b17149a42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:16.751433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7ff88154-f6f3-4ffc-a008-503b17149a42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:16.814036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7ff88154-f6f3-4ffc-a008-503b17149a42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:15:16.821877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7ff88154-f6f3-4ffc-a008-503b17149a42 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f" status: 200 len: 1225 microversion: 2.1 time: 0.084114 May 26 13:15:16.822433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 750/1527] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:15:16 2022] GET /compute/v2.1/servers/cf382a59-333a-43e5-9760-6a443183cc3f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:15:18.305708 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b752985c-111b-47de-a3e8-fbe4b03e0f52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:15:18.306296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b752985c-111b-47de-a3e8-fbe4b03e0f52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:15:18.312895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b752985c-111b-47de-a3e8-fbe4b03e0f52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:18.313339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b752985c-111b-47de-a3e8-fbe4b03e0f52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:18.314101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b752985c-111b-47de-a3e8-fbe4b03e0f52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:15:18.314549 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b752985c-111b-47de-a3e8-fbe4b03e0f52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:15:18.402193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-b752985c-111b-47de-a3e8-fbe4b03e0f52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lazy-loading 'services' on Instance uuid a03f3c20-ca70-497d-a163-d7c152799be2 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:15:18.672082 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b752985c-111b-47de-a3e8-fbe4b03e0f52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2/os-volume_attachments/b982ab7e-ccb7-4fd6-940c-be9867d4484c" status: 202 len: 0 microversion: 2.1 time: 0.370593 May 26 13:15:18.672983 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 778/1528] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 13:15:18 2022] DELETE /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2/os-volume_attachments/b982ab7e-ccb7-4fd6-940c-be9867d4484c => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:15:57.993407 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:15:57.994102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:15:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:16:04.949031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:16:04.949758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:16:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:17:45.798458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:17:45.800123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:17:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:18:03.412650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:18:03.413375 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:18:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:18:13.267778 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:18:13.268403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:18:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:18:33.363705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:18:33.364264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:18:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:19:18.002930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:19:18.002930 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:19:24.957145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:19:24.957963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:21:05.810806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:21:05.811417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:21:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:21:18.470467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13d1f0c7-cdff-4727-920c-751392da3fd3] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 13:21:18.471310 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=17 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:18.472052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=47 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:18.478940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:18.479443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:18.486034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:18.486738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:18.487298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:18.487744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:18.519431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:21:18.760475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [27ece1bb-d756-4f1a-9547-9ab42b8f0ffd] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 13:21:19.477966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] [13d1f0c7-cdff-4727-920c-751392da3fd3] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 55454. May 26 13:21:19.769063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [27ece1bb-d756-4f1a-9547-9ab42b8f0ffd] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 55458. May 26 13:21:19.851499 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4acba2a4-5e94-4d0d-b4fe-a8ef12a2375f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 204 len: 0 microversion: 2.1 time: 1.382681 May 26 13:21:19.852082 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 751/1529] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:21:18 2022] DELETE /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 0 bytes in 1384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:21:19.859472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b3b9eca4-4f20-401c-bcf6-4a434357ddcc] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 13:21:19.866062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=19 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:19.866062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:19.866062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ecf696fe-7132-4887-a1ca-d117cd4965ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:19.866062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ecf696fe-7132-4887-a1ca-d117cd4965ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:19.873423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ecf696fe-7132-4887-a1ca-d117cd4965ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:19.873877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ecf696fe-7132-4887-a1ca-d117cd4965ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:19.874682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ecf696fe-7132-4887-a1ca-d117cd4965ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:19.875129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ecf696fe-7132-4887-a1ca-d117cd4965ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:20.128657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ecf696fe-7132-4887-a1ca-d117cd4965ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:20.136651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ecf696fe-7132-4887-a1ca-d117cd4965ef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.279074 May 26 13:21:20.137212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 779/1530] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:19 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:21.154145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d905620f-3545-4a5e-aeb2-0750d3e5733c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:21.154880 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d905620f-3545-4a5e-aeb2-0750d3e5733c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:21.167781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d905620f-3545-4a5e-aeb2-0750d3e5733c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:21.168530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d905620f-3545-4a5e-aeb2-0750d3e5733c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:21.169345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d905620f-3545-4a5e-aeb2-0750d3e5733c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:21.169803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d905620f-3545-4a5e-aeb2-0750d3e5733c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:21.359428 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d905620f-3545-4a5e-aeb2-0750d3e5733c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:21.367470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d905620f-3545-4a5e-aeb2-0750d3e5733c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.217915 May 26 13:21:21.368941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 752/1531] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:21 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:22.385383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-47e49499-80ff-4ea9-affc-e308acfad210 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:22.385993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-47e49499-80ff-4ea9-affc-e308acfad210 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:22.399502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47e49499-80ff-4ea9-affc-e308acfad210 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:22.399953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47e49499-80ff-4ea9-affc-e308acfad210 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:22.400758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47e49499-80ff-4ea9-affc-e308acfad210 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:22.401229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47e49499-80ff-4ea9-affc-e308acfad210 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:22.402097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] [b3b9eca4-4f20-401c-bcf6-4a434357ddcc] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 55480. May 26 13:21:22.533896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-47e49499-80ff-4ea9-affc-e308acfad210 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:22.541959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-47e49499-80ff-4ea9-affc-e308acfad210 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.160484 May 26 13:21:22.542534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 780/1532] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:22 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:23.420999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:21:23.421700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:21:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:21:23.559761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-66c9ef86-7b44-4766-b0a5-b087a159259a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:23.560356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-66c9ef86-7b44-4766-b0a5-b087a159259a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:23.566836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66c9ef86-7b44-4766-b0a5-b087a159259a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:23.567286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66c9ef86-7b44-4766-b0a5-b087a159259a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:23.568052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66c9ef86-7b44-4766-b0a5-b087a159259a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:23.568487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66c9ef86-7b44-4766-b0a5-b087a159259a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:23.697513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-66c9ef86-7b44-4766-b0a5-b087a159259a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:23.706121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-66c9ef86-7b44-4766-b0a5-b087a159259a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150600 May 26 13:21:23.706793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 753/1533] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:23 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:24.724005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be0603ae-bef5-4fb4-829c-9b8cb99bc05b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:24.724626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be0603ae-bef5-4fb4-829c-9b8cb99bc05b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:24.732127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be0603ae-bef5-4fb4-829c-9b8cb99bc05b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:24.732577 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be0603ae-bef5-4fb4-829c-9b8cb99bc05b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:24.733350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be0603ae-bef5-4fb4-829c-9b8cb99bc05b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:24.733785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be0603ae-bef5-4fb4-829c-9b8cb99bc05b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:24.869251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be0603ae-bef5-4fb4-829c-9b8cb99bc05b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:24.877609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be0603ae-bef5-4fb4-829c-9b8cb99bc05b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157401 May 26 13:21:24.878184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 781/1534] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:24 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:25.895485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0407586e-e853-4d6c-beda-07bac1140b12 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:25.896127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0407586e-e853-4d6c-beda-07bac1140b12 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:25.903218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0407586e-e853-4d6c-beda-07bac1140b12 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:25.903672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0407586e-e853-4d6c-beda-07bac1140b12 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:25.904440 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0407586e-e853-4d6c-beda-07bac1140b12 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:25.904876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0407586e-e853-4d6c-beda-07bac1140b12 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:26.038231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0407586e-e853-4d6c-beda-07bac1140b12 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:26.047423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0407586e-e853-4d6c-beda-07bac1140b12 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155924 May 26 13:21:26.047990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 754/1535] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:25 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:27.065211 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3618b33b-55fc-4c33-86b2-3729af15dff8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:27.065825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3618b33b-55fc-4c33-86b2-3729af15dff8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:27.072451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3618b33b-55fc-4c33-86b2-3729af15dff8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:27.072907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3618b33b-55fc-4c33-86b2-3729af15dff8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:27.073680 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3618b33b-55fc-4c33-86b2-3729af15dff8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:27.074720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3618b33b-55fc-4c33-86b2-3729af15dff8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:27.206456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3618b33b-55fc-4c33-86b2-3729af15dff8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:27.214993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3618b33b-55fc-4c33-86b2-3729af15dff8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153113 May 26 13:21:27.215590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 782/1536] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:27 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:28.233541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-47de69b6-080e-4620-9f46-657e4bc8d6be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:28.234164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-47de69b6-080e-4620-9f46-657e4bc8d6be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:28.241149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47de69b6-080e-4620-9f46-657e4bc8d6be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:28.244624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47de69b6-080e-4620-9f46-657e4bc8d6be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:28.244624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47de69b6-080e-4620-9f46-657e4bc8d6be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:28.244624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47de69b6-080e-4620-9f46-657e4bc8d6be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:28.374364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-47de69b6-080e-4620-9f46-657e4bc8d6be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:28.382348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-47de69b6-080e-4620-9f46-657e4bc8d6be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153768 May 26 13:21:28.382943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 755/1537] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:28 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:29.401131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a1675f9b-0683-410f-af91-e51df2104591 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:29.402223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a1675f9b-0683-410f-af91-e51df2104591 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:29.409062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1675f9b-0683-410f-af91-e51df2104591 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:29.411036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1675f9b-0683-410f-af91-e51df2104591 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:29.411036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1675f9b-0683-410f-af91-e51df2104591 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:29.411036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1675f9b-0683-410f-af91-e51df2104591 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:29.544862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a1675f9b-0683-410f-af91-e51df2104591 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:29.552789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a1675f9b-0683-410f-af91-e51df2104591 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155644 May 26 13:21:29.553344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 783/1538] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:29 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:30.569964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-861977c0-a294-4c9e-b2ee-4384a1814441 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:30.570517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-861977c0-a294-4c9e-b2ee-4384a1814441 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:30.577332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-861977c0-a294-4c9e-b2ee-4384a1814441 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:30.577785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-861977c0-a294-4c9e-b2ee-4384a1814441 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:30.578576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-861977c0-a294-4c9e-b2ee-4384a1814441 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:30.579024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-861977c0-a294-4c9e-b2ee-4384a1814441 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:30.712122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-861977c0-a294-4c9e-b2ee-4384a1814441 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:30.720725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-861977c0-a294-4c9e-b2ee-4384a1814441 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154711 May 26 13:21:30.721291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 756/1539] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:30 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:31.738841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f1d6b14-f70a-449a-8a91-96c4d2d19102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:31.739459 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5f1d6b14-f70a-449a-8a91-96c4d2d19102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:31.746622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f1d6b14-f70a-449a-8a91-96c4d2d19102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:31.747302 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f1d6b14-f70a-449a-8a91-96c4d2d19102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:31.748059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f1d6b14-f70a-449a-8a91-96c4d2d19102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:31.748492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f1d6b14-f70a-449a-8a91-96c4d2d19102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:31.878308 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5f1d6b14-f70a-449a-8a91-96c4d2d19102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:31.886799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f1d6b14-f70a-449a-8a91-96c4d2d19102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151290 May 26 13:21:31.887943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 784/1540] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:31 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:32.905685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b597456e-fbcd-4cc5-b2bd-98d767d565aa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:32.906299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b597456e-fbcd-4cc5-b2bd-98d767d565aa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:32.912752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b597456e-fbcd-4cc5-b2bd-98d767d565aa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:32.913209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b597456e-fbcd-4cc5-b2bd-98d767d565aa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:32.913972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b597456e-fbcd-4cc5-b2bd-98d767d565aa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:32.914418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b597456e-fbcd-4cc5-b2bd-98d767d565aa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:33.044309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b597456e-fbcd-4cc5-b2bd-98d767d565aa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:33.052696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b597456e-fbcd-4cc5-b2bd-98d767d565aa tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151907 May 26 13:21:33.053288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 757/1541] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:32 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:34.070250 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-530e403b-e7bc-4d5f-8ce0-0d87a4e670cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:34.070875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-530e403b-e7bc-4d5f-8ce0-0d87a4e670cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:34.077490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-530e403b-e7bc-4d5f-8ce0-0d87a4e670cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:34.077937 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-530e403b-e7bc-4d5f-8ce0-0d87a4e670cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:34.078751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-530e403b-e7bc-4d5f-8ce0-0d87a4e670cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:34.079180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-530e403b-e7bc-4d5f-8ce0-0d87a4e670cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:34.211742 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-530e403b-e7bc-4d5f-8ce0-0d87a4e670cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:34.220561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-530e403b-e7bc-4d5f-8ce0-0d87a4e670cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154291 May 26 13:21:34.221149 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 785/1542] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:34 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:35.239435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0462b9e5-fb82-40a5-9a21-cc98d3e8178d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:35.240050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0462b9e5-fb82-40a5-9a21-cc98d3e8178d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:35.247167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0462b9e5-fb82-40a5-9a21-cc98d3e8178d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:35.247626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0462b9e5-fb82-40a5-9a21-cc98d3e8178d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:35.248411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0462b9e5-fb82-40a5-9a21-cc98d3e8178d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:35.248848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0462b9e5-fb82-40a5-9a21-cc98d3e8178d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:35.384508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0462b9e5-fb82-40a5-9a21-cc98d3e8178d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:35.393396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0462b9e5-fb82-40a5-9a21-cc98d3e8178d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157804 May 26 13:21:35.393957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 758/1543] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:35 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:21:36.411489 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4a99b5ae-b70c-4cee-aed4-8bde5d2e3654 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:36.412106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a99b5ae-b70c-4cee-aed4-8bde5d2e3654 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:36.418974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a99b5ae-b70c-4cee-aed4-8bde5d2e3654 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:36.419420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a99b5ae-b70c-4cee-aed4-8bde5d2e3654 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:36.420191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a99b5ae-b70c-4cee-aed4-8bde5d2e3654 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:36.420624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a99b5ae-b70c-4cee-aed4-8bde5d2e3654 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:36.567024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4a99b5ae-b70c-4cee-aed4-8bde5d2e3654 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:36.575241 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4a99b5ae-b70c-4cee-aed4-8bde5d2e3654 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.167768 May 26 13:21:36.575826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 786/1544] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:36 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:37.594198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9081e3bc-a9a9-4dde-821a-a5475cc5c023 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:37.594929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9081e3bc-a9a9-4dde-821a-a5475cc5c023 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:37.602454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9081e3bc-a9a9-4dde-821a-a5475cc5c023 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:37.602943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9081e3bc-a9a9-4dde-821a-a5475cc5c023 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:37.603725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9081e3bc-a9a9-4dde-821a-a5475cc5c023 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:37.604185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9081e3bc-a9a9-4dde-821a-a5475cc5c023 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:37.747592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9081e3bc-a9a9-4dde-821a-a5475cc5c023 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:37.756200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9081e3bc-a9a9-4dde-821a-a5475cc5c023 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.166579 May 26 13:21:37.756786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 759/1545] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:37 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:38.774380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d0223f45-6141-4485-a47a-35a56c383e29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:38.775061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d0223f45-6141-4485-a47a-35a56c383e29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:38.782491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0223f45-6141-4485-a47a-35a56c383e29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:38.783022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0223f45-6141-4485-a47a-35a56c383e29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:38.783841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0223f45-6141-4485-a47a-35a56c383e29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:38.784314 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0223f45-6141-4485-a47a-35a56c383e29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:38.922542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0223f45-6141-4485-a47a-35a56c383e29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:38.930908 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d0223f45-6141-4485-a47a-35a56c383e29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.160788 May 26 13:21:38.931491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 787/1546] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:38 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:39.948574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-040ad7e0-e3ca-4518-a7e4-076700d4d4c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:39.949208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-040ad7e0-e3ca-4518-a7e4-076700d4d4c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:39.956253 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-040ad7e0-e3ca-4518-a7e4-076700d4d4c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:39.956701 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-040ad7e0-e3ca-4518-a7e4-076700d4d4c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:39.957465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-040ad7e0-e3ca-4518-a7e4-076700d4d4c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:39.957900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-040ad7e0-e3ca-4518-a7e4-076700d4d4c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:40.089599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-040ad7e0-e3ca-4518-a7e4-076700d4d4c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:40.097996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-040ad7e0-e3ca-4518-a7e4-076700d4d4c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153247 May 26 13:21:40.098585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 760/1547] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:39 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:41.114867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af825546-90ed-4f60-8b00-782a923cb590 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:41.115473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af825546-90ed-4f60-8b00-782a923cb590 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:41.121850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af825546-90ed-4f60-8b00-782a923cb590 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:41.122295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af825546-90ed-4f60-8b00-782a923cb590 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:41.123072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af825546-90ed-4f60-8b00-782a923cb590 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:41.123506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af825546-90ed-4f60-8b00-782a923cb590 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:41.258456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af825546-90ed-4f60-8b00-782a923cb590 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:41.267155 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af825546-90ed-4f60-8b00-782a923cb590 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156075 May 26 13:21:41.267718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 788/1548] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:41 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:42.285305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c084b130-0178-4ad0-8208-4461aea68e5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:42.286167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c084b130-0178-4ad0-8208-4461aea68e5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:42.292991 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c084b130-0178-4ad0-8208-4461aea68e5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:42.293440 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c084b130-0178-4ad0-8208-4461aea68e5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:42.294214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c084b130-0178-4ad0-8208-4461aea68e5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:42.294709 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c084b130-0178-4ad0-8208-4461aea68e5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:42.428027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c084b130-0178-4ad0-8208-4461aea68e5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:42.436211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c084b130-0178-4ad0-8208-4461aea68e5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155540 May 26 13:21:42.436783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 761/1549] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:42 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:43.452995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c44c6c6d-dd4e-4108-b627-003a2952c683 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:43.454243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c44c6c6d-dd4e-4108-b627-003a2952c683 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:43.461074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c44c6c6d-dd4e-4108-b627-003a2952c683 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:43.461524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c44c6c6d-dd4e-4108-b627-003a2952c683 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:43.462285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c44c6c6d-dd4e-4108-b627-003a2952c683 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:43.462752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c44c6c6d-dd4e-4108-b627-003a2952c683 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:43.597184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c44c6c6d-dd4e-4108-b627-003a2952c683 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:43.607376 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c44c6c6d-dd4e-4108-b627-003a2952c683 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158032 May 26 13:21:43.607946 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 789/1550] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:43 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:44.629263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49b8987a-dfe5-4c98-b2e6-971fd5fd056b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:44.629881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49b8987a-dfe5-4c98-b2e6-971fd5fd056b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:44.636714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49b8987a-dfe5-4c98-b2e6-971fd5fd056b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:44.637168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49b8987a-dfe5-4c98-b2e6-971fd5fd056b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:44.637931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49b8987a-dfe5-4c98-b2e6-971fd5fd056b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:44.638367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49b8987a-dfe5-4c98-b2e6-971fd5fd056b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:44.768586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49b8987a-dfe5-4c98-b2e6-971fd5fd056b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:44.777075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49b8987a-dfe5-4c98-b2e6-971fd5fd056b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152000 May 26 13:21:44.777658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 762/1551] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:44 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:45.795132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a880146-9205-47f0-9010-c4a08ffd6949 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:45.796871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a880146-9205-47f0-9010-c4a08ffd6949 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:45.802187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a880146-9205-47f0-9010-c4a08ffd6949 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:45.802672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a880146-9205-47f0-9010-c4a08ffd6949 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:45.803450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a880146-9205-47f0-9010-c4a08ffd6949 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:45.803879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a880146-9205-47f0-9010-c4a08ffd6949 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:45.940803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a880146-9205-47f0-9010-c4a08ffd6949 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:45.948747 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a880146-9205-47f0-9010-c4a08ffd6949 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157413 May 26 13:21:45.949313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 790/1552] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:45 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:46.966804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8693bd77-25d1-4f1d-a36e-e999075cf745 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:46.967417 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8693bd77-25d1-4f1d-a36e-e999075cf745 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:46.975011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8693bd77-25d1-4f1d-a36e-e999075cf745 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:46.975467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8693bd77-25d1-4f1d-a36e-e999075cf745 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:46.976287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8693bd77-25d1-4f1d-a36e-e999075cf745 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:46.976720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8693bd77-25d1-4f1d-a36e-e999075cf745 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:47.111453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8693bd77-25d1-4f1d-a36e-e999075cf745 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:47.127677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8693bd77-25d1-4f1d-a36e-e999075cf745 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.164674 May 26 13:21:47.128257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 763/1553] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:46 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:48.145701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9797ce4c-2835-42aa-ac04-30ebdc9b294c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:48.146346 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9797ce4c-2835-42aa-ac04-30ebdc9b294c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:48.154405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9797ce4c-2835-42aa-ac04-30ebdc9b294c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:48.154906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9797ce4c-2835-42aa-ac04-30ebdc9b294c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:48.155678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9797ce4c-2835-42aa-ac04-30ebdc9b294c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:48.156118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9797ce4c-2835-42aa-ac04-30ebdc9b294c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:48.295246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9797ce4c-2835-42aa-ac04-30ebdc9b294c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:48.303883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9797ce4c-2835-42aa-ac04-30ebdc9b294c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.162190 May 26 13:21:48.304473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 791/1554] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:48 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:49.321738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc08adb0-1f44-45ec-b4ca-e9bf41d7f475 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:49.322346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc08adb0-1f44-45ec-b4ca-e9bf41d7f475 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:49.324653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:49.329436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc08adb0-1f44-45ec-b4ca-e9bf41d7f475 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:49.329888 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc08adb0-1f44-45ec-b4ca-e9bf41d7f475 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:49.330741 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc08adb0-1f44-45ec-b4ca-e9bf41d7f475 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:49.331190 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc08adb0-1f44-45ec-b4ca-e9bf41d7f475 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:49.345318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:49.462788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc08adb0-1f44-45ec-b4ca-e9bf41d7f475 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:49.471462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc08adb0-1f44-45ec-b4ca-e9bf41d7f475 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153637 May 26 13:21:49.474539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 764/1555] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:49 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:50.489742 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3602c432-4daa-4870-8bc6-67423806bf96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:50.490392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3602c432-4daa-4870-8bc6-67423806bf96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:50.493026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=27 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:50.497746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3602c432-4daa-4870-8bc6-67423806bf96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:50.498204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3602c432-4daa-4870-8bc6-67423806bf96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:50.499008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3602c432-4daa-4870-8bc6-67423806bf96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:50.499461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3602c432-4daa-4870-8bc6-67423806bf96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:50.504063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=79 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:50.634147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3602c432-4daa-4870-8bc6-67423806bf96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:50.642140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3602c432-4daa-4870-8bc6-67423806bf96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156338 May 26 13:21:50.642728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 792/1556] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:50 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:21:51.660623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5f6956d-32b2-4aa4-910a-814b9c69e1cf tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:51.661282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5f6956d-32b2-4aa4-910a-814b9c69e1cf tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:51.668332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f6956d-32b2-4aa4-910a-814b9c69e1cf tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:51.674006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f6956d-32b2-4aa4-910a-814b9c69e1cf tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:51.674006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f6956d-32b2-4aa4-910a-814b9c69e1cf tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:51.674006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f6956d-32b2-4aa4-910a-814b9c69e1cf tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:51.799725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f5f6956d-32b2-4aa4-910a-814b9c69e1cf tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:51.807660 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5f6956d-32b2-4aa4-910a-814b9c69e1cf tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151886 May 26 13:21:51.808228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 765/1557] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:51 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:52.825500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1392b8af-ec7d-49a4-8c19-573a571593ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:52.826097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1392b8af-ec7d-49a4-8c19-573a571593ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:52.832976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1392b8af-ec7d-49a4-8c19-573a571593ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:52.833431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1392b8af-ec7d-49a4-8c19-573a571593ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:52.834199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1392b8af-ec7d-49a4-8c19-573a571593ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:52.834670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1392b8af-ec7d-49a4-8c19-573a571593ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:52.969266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1392b8af-ec7d-49a4-8c19-573a571593ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:52.977686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1392b8af-ec7d-49a4-8c19-573a571593ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155796 May 26 13:21:52.978246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 793/1558] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:52 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:21:53.372013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:21:53.372291 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:21:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:21:53.995725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb26adf9-fa94-4d41-b234-2c6c351b8951 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:53.996429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb26adf9-fa94-4d41-b234-2c6c351b8951 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:54.004032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb26adf9-fa94-4d41-b234-2c6c351b8951 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:54.004487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb26adf9-fa94-4d41-b234-2c6c351b8951 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:54.005259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb26adf9-fa94-4d41-b234-2c6c351b8951 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:54.005699 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb26adf9-fa94-4d41-b234-2c6c351b8951 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:54.138394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bb26adf9-fa94-4d41-b234-2c6c351b8951 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:54.147577 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb26adf9-fa94-4d41-b234-2c6c351b8951 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155774 May 26 13:21:54.148146 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 766/1559] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:53 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:55.164868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ad8b3c8e-5f51-40a2-903e-f6cf3390a8c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:55.165498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ad8b3c8e-5f51-40a2-903e-f6cf3390a8c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:55.172544 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad8b3c8e-5f51-40a2-903e-f6cf3390a8c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:55.173162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad8b3c8e-5f51-40a2-903e-f6cf3390a8c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:55.173942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad8b3c8e-5f51-40a2-903e-f6cf3390a8c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:55.174385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad8b3c8e-5f51-40a2-903e-f6cf3390a8c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:55.308144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ad8b3c8e-5f51-40a2-903e-f6cf3390a8c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:55.316694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ad8b3c8e-5f51-40a2-903e-f6cf3390a8c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155672 May 26 13:21:55.317255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 794/1560] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:55 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:56.333881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b79be5e7-73f2-4ea3-a51d-21677a635773 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:56.334472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b79be5e7-73f2-4ea3-a51d-21677a635773 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:56.341443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b79be5e7-73f2-4ea3-a51d-21677a635773 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:56.341898 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b79be5e7-73f2-4ea3-a51d-21677a635773 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:56.342799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b79be5e7-73f2-4ea3-a51d-21677a635773 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:56.343241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b79be5e7-73f2-4ea3-a51d-21677a635773 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:56.479687 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b79be5e7-73f2-4ea3-a51d-21677a635773 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:56.488042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b79be5e7-73f2-4ea3-a51d-21677a635773 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157969 May 26 13:21:56.488631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 767/1561] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:56 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:57.506355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92c8ef0a-e823-42d3-a239-af977f5c6dc8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:57.506995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92c8ef0a-e823-42d3-a239-af977f5c6dc8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:57.513575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c8ef0a-e823-42d3-a239-af977f5c6dc8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:57.514026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c8ef0a-e823-42d3-a239-af977f5c6dc8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:57.514822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c8ef0a-e823-42d3-a239-af977f5c6dc8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:57.515261 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c8ef0a-e823-42d3-a239-af977f5c6dc8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:57.659993 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92c8ef0a-e823-42d3-a239-af977f5c6dc8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:57.668316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92c8ef0a-e823-42d3-a239-af977f5c6dc8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.165752 May 26 13:21:57.668884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 795/1562] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:57 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:58.688650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23acddbe-5a79-4fcc-acef-06761d05389f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:58.689345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23acddbe-5a79-4fcc-acef-06761d05389f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:58.697361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23acddbe-5a79-4fcc-acef-06761d05389f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:58.697810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23acddbe-5a79-4fcc-acef-06761d05389f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:58.698617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23acddbe-5a79-4fcc-acef-06761d05389f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:58.699061 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23acddbe-5a79-4fcc-acef-06761d05389f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:58.857043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23acddbe-5a79-4fcc-acef-06761d05389f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:21:58.864220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23acddbe-5a79-4fcc-acef-06761d05389f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.182643 May 26 13:21:58.864781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 768/1563] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:58 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:21:59.881653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cdd464c3-9d76-46ff-a960-f7aa4be5f33b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:21:59.882266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cdd464c3-9d76-46ff-a960-f7aa4be5f33b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:21:59.888759 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd464c3-9d76-46ff-a960-f7aa4be5f33b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:59.889208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd464c3-9d76-46ff-a960-f7aa4be5f33b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:21:59.889985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd464c3-9d76-46ff-a960-f7aa4be5f33b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:21:59.890421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd464c3-9d76-46ff-a960-f7aa4be5f33b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:00.027061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cdd464c3-9d76-46ff-a960-f7aa4be5f33b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:00.035884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cdd464c3-9d76-46ff-a960-f7aa4be5f33b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158008 May 26 13:22:00.036466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 796/1564] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:21:59 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:01.053682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-288d527d-ec7f-4cce-b75e-b41d23b76d4b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:01.054327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-288d527d-ec7f-4cce-b75e-b41d23b76d4b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:01.060897 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-288d527d-ec7f-4cce-b75e-b41d23b76d4b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:01.061347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-288d527d-ec7f-4cce-b75e-b41d23b76d4b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:01.062108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-288d527d-ec7f-4cce-b75e-b41d23b76d4b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:01.062567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-288d527d-ec7f-4cce-b75e-b41d23b76d4b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:01.193226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-288d527d-ec7f-4cce-b75e-b41d23b76d4b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:01.201163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-288d527d-ec7f-4cce-b75e-b41d23b76d4b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151345 May 26 13:22:01.201757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 769/1565] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:01 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:22:02.219581 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-853b042c-126b-44ce-be6c-d4bf60fb8fb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:02.220186 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-853b042c-126b-44ce-be6c-d4bf60fb8fb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:02.227682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-853b042c-126b-44ce-be6c-d4bf60fb8fb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:02.228197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-853b042c-126b-44ce-be6c-d4bf60fb8fb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:02.228956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-853b042c-126b-44ce-be6c-d4bf60fb8fb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:02.229392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-853b042c-126b-44ce-be6c-d4bf60fb8fb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:02.359513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-853b042c-126b-44ce-be6c-d4bf60fb8fb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:02.368022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-853b042c-126b-44ce-be6c-d4bf60fb8fb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152262 May 26 13:22:02.368587 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 797/1566] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:02 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:03.386093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-883e2b9b-3b77-448c-91f1-0da9c35dbe5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:03.386728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-883e2b9b-3b77-448c-91f1-0da9c35dbe5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:03.394291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-883e2b9b-3b77-448c-91f1-0da9c35dbe5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:03.394775 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-883e2b9b-3b77-448c-91f1-0da9c35dbe5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:03.395561 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-883e2b9b-3b77-448c-91f1-0da9c35dbe5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:03.396002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-883e2b9b-3b77-448c-91f1-0da9c35dbe5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:03.537071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-883e2b9b-3b77-448c-91f1-0da9c35dbe5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:03.547702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-883e2b9b-3b77-448c-91f1-0da9c35dbe5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.165582 May 26 13:22:03.548265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 770/1567] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:03 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:04.565830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6dfda13d-45fa-4887-87c5-e9dafa977136 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:04.566398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6dfda13d-45fa-4887-87c5-e9dafa977136 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:04.572810 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dfda13d-45fa-4887-87c5-e9dafa977136 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:04.573255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dfda13d-45fa-4887-87c5-e9dafa977136 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:04.574016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dfda13d-45fa-4887-87c5-e9dafa977136 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:04.574449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dfda13d-45fa-4887-87c5-e9dafa977136 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:04.719106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6dfda13d-45fa-4887-87c5-e9dafa977136 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:04.727597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6dfda13d-45fa-4887-87c5-e9dafa977136 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.165970 May 26 13:22:04.728169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 798/1568] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:04 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:05.745736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ebf71af7-b85f-48df-be6b-188afbd113ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:05.746354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ebf71af7-b85f-48df-be6b-188afbd113ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:05.753094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebf71af7-b85f-48df-be6b-188afbd113ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:05.754111 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebf71af7-b85f-48df-be6b-188afbd113ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:05.755098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebf71af7-b85f-48df-be6b-188afbd113ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:05.755545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebf71af7-b85f-48df-be6b-188afbd113ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:05.883266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebf71af7-b85f-48df-be6b-188afbd113ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:05.891078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ebf71af7-b85f-48df-be6b-188afbd113ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149591 May 26 13:22:05.891632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 771/1569] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:05 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:06.909065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92123370-1c13-4936-8f87-1ba1f79d7c68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:06.909670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92123370-1c13-4936-8f87-1ba1f79d7c68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:06.917262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92123370-1c13-4936-8f87-1ba1f79d7c68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:06.917716 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92123370-1c13-4936-8f87-1ba1f79d7c68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:06.918492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92123370-1c13-4936-8f87-1ba1f79d7c68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:06.918961 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92123370-1c13-4936-8f87-1ba1f79d7c68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:07.053641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92123370-1c13-4936-8f87-1ba1f79d7c68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:07.061637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92123370-1c13-4936-8f87-1ba1f79d7c68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156521 May 26 13:22:07.062204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 799/1570] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:06 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:08.078856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-004957d1-a2cf-4a7a-afa3-f155b39dd0f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:08.079576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-004957d1-a2cf-4a7a-afa3-f155b39dd0f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:08.086711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-004957d1-a2cf-4a7a-afa3-f155b39dd0f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:08.087168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-004957d1-a2cf-4a7a-afa3-f155b39dd0f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:08.087932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-004957d1-a2cf-4a7a-afa3-f155b39dd0f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:08.088368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-004957d1-a2cf-4a7a-afa3-f155b39dd0f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:08.219315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-004957d1-a2cf-4a7a-afa3-f155b39dd0f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:08.227628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-004957d1-a2cf-4a7a-afa3-f155b39dd0f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152279 May 26 13:22:08.228198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 772/1571] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:08 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:09.244569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-81499e3d-5555-4de0-83dd-3fafd344d729 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:09.245186 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-81499e3d-5555-4de0-83dd-3fafd344d729 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:09.251811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81499e3d-5555-4de0-83dd-3fafd344d729 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:09.252265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81499e3d-5555-4de0-83dd-3fafd344d729 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:09.253035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81499e3d-5555-4de0-83dd-3fafd344d729 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:09.253474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81499e3d-5555-4de0-83dd-3fafd344d729 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:09.387900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81499e3d-5555-4de0-83dd-3fafd344d729 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:09.396877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-81499e3d-5555-4de0-83dd-3fafd344d729 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156159 May 26 13:22:09.397470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 800/1572] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:09 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:10.415740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-21fceca2-a906-41f2-a15f-a9e5ed2cddd0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:10.416361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-21fceca2-a906-41f2-a15f-a9e5ed2cddd0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:10.423530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21fceca2-a906-41f2-a15f-a9e5ed2cddd0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:10.425906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21fceca2-a906-41f2-a15f-a9e5ed2cddd0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:10.425906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21fceca2-a906-41f2-a15f-a9e5ed2cddd0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:10.425906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21fceca2-a906-41f2-a15f-a9e5ed2cddd0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:10.570958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-21fceca2-a906-41f2-a15f-a9e5ed2cddd0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:10.578907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-21fceca2-a906-41f2-a15f-a9e5ed2cddd0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.168375 May 26 13:22:10.579474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 773/1573] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:10 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:11.596550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cd4f9db6-b644-4c28-bc6e-bbab6ad207de tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:11.597206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cd4f9db6-b644-4c28-bc6e-bbab6ad207de tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:11.604327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd4f9db6-b644-4c28-bc6e-bbab6ad207de tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:11.604784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd4f9db6-b644-4c28-bc6e-bbab6ad207de tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:11.605600 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd4f9db6-b644-4c28-bc6e-bbab6ad207de tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:11.606041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd4f9db6-b644-4c28-bc6e-bbab6ad207de tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:11.741296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cd4f9db6-b644-4c28-bc6e-bbab6ad207de tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:11.751255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cd4f9db6-b644-4c28-bc6e-bbab6ad207de tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158168 May 26 13:22:11.752307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 801/1574] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:11 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:12.771691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba287c25-0fb1-44dd-8814-a3a950f0865d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:12.772610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba287c25-0fb1-44dd-8814-a3a950f0865d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:12.781017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba287c25-0fb1-44dd-8814-a3a950f0865d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:12.781471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba287c25-0fb1-44dd-8814-a3a950f0865d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:12.782406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba287c25-0fb1-44dd-8814-a3a950f0865d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:12.783096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba287c25-0fb1-44dd-8814-a3a950f0865d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:12.911701 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba287c25-0fb1-44dd-8814-a3a950f0865d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:12.919649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba287c25-0fb1-44dd-8814-a3a950f0865d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152780 May 26 13:22:12.920209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 774/1575] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:12 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:13.937382 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12bc57eb-ea6a-43bc-bb99-3b37129d2ca2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:13.937984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12bc57eb-ea6a-43bc-bb99-3b37129d2ca2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:13.944958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12bc57eb-ea6a-43bc-bb99-3b37129d2ca2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:13.945403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12bc57eb-ea6a-43bc-bb99-3b37129d2ca2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:13.946158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12bc57eb-ea6a-43bc-bb99-3b37129d2ca2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:13.946628 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12bc57eb-ea6a-43bc-bb99-3b37129d2ca2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:14.243038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12bc57eb-ea6a-43bc-bb99-3b37129d2ca2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:14.250962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12bc57eb-ea6a-43bc-bb99-3b37129d2ca2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.317597 May 26 13:22:14.251515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 802/1576] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:13 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:15.268646 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dea38437-e8ff-4a45-bcc1-b9c354525015 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:15.269263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dea38437-e8ff-4a45-bcc1-b9c354525015 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:15.276526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dea38437-e8ff-4a45-bcc1-b9c354525015 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:15.277198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dea38437-e8ff-4a45-bcc1-b9c354525015 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:15.277897 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dea38437-e8ff-4a45-bcc1-b9c354525015 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:15.278343 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dea38437-e8ff-4a45-bcc1-b9c354525015 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:15.412520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dea38437-e8ff-4a45-bcc1-b9c354525015 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:15.420405 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dea38437-e8ff-4a45-bcc1-b9c354525015 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155595 May 26 13:22:15.420960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 775/1577] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:15 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:16.438111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a78a2e37-4a17-4f6e-a500-d070ca9ab6e6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:16.439262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a78a2e37-4a17-4f6e-a500-d070ca9ab6e6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:16.446676 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a78a2e37-4a17-4f6e-a500-d070ca9ab6e6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:16.447245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a78a2e37-4a17-4f6e-a500-d070ca9ab6e6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:16.448020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a78a2e37-4a17-4f6e-a500-d070ca9ab6e6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:16.448453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a78a2e37-4a17-4f6e-a500-d070ca9ab6e6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:16.576523 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a78a2e37-4a17-4f6e-a500-d070ca9ab6e6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:16.585091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a78a2e37-4a17-4f6e-a500-d070ca9ab6e6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150967 May 26 13:22:16.585656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 803/1578] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:16 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:17.606554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-24690fe0-2a69-4be2-bfda-4889d54bd9bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:17.607119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-24690fe0-2a69-4be2-bfda-4889d54bd9bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:17.613616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24690fe0-2a69-4be2-bfda-4889d54bd9bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:17.614070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24690fe0-2a69-4be2-bfda-4889d54bd9bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:17.614895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24690fe0-2a69-4be2-bfda-4889d54bd9bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:17.615341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24690fe0-2a69-4be2-bfda-4889d54bd9bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:17.746307 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-24690fe0-2a69-4be2-bfda-4889d54bd9bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:17.754292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-24690fe0-2a69-4be2-bfda-4889d54bd9bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153206 May 26 13:22:17.754895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 776/1579] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:17 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:18.775775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c9a5770d-1bf3-4fc6-a393-355204be3114 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:18.776508 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c9a5770d-1bf3-4fc6-a393-355204be3114 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:18.783207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9a5770d-1bf3-4fc6-a393-355204be3114 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:18.783652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9a5770d-1bf3-4fc6-a393-355204be3114 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:18.784414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9a5770d-1bf3-4fc6-a393-355204be3114 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:18.784850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9a5770d-1bf3-4fc6-a393-355204be3114 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:18.910211 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9a5770d-1bf3-4fc6-a393-355204be3114 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:18.918823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c9a5770d-1bf3-4fc6-a393-355204be3114 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.146854 May 26 13:22:18.919372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 804/1580] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:18 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:19.936628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-578f7a69-7251-46ad-be64-7a9d7e41f4be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:19.937240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-578f7a69-7251-46ad-be64-7a9d7e41f4be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:19.943597 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-578f7a69-7251-46ad-be64-7a9d7e41f4be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:19.944053 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-578f7a69-7251-46ad-be64-7a9d7e41f4be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:19.944826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-578f7a69-7251-46ad-be64-7a9d7e41f4be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:19.945265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-578f7a69-7251-46ad-be64-7a9d7e41f4be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:20.081988 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-578f7a69-7251-46ad-be64-7a9d7e41f4be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:20.090381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-578f7a69-7251-46ad-be64-7a9d7e41f4be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157792 May 26 13:22:20.090975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 777/1581] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:19 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:21.108404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-26781ce0-7d18-4c6d-a078-a4a41daa14a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:21.109029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-26781ce0-7d18-4c6d-a078-a4a41daa14a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:21.111336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:21.116614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26781ce0-7d18-4c6d-a078-a4a41daa14a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:21.117070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26781ce0-7d18-4c6d-a078-a4a41daa14a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:21.117844 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26781ce0-7d18-4c6d-a078-a4a41daa14a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:21.118290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26781ce0-7d18-4c6d-a078-a4a41daa14a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:21.120872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:21.254029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-26781ce0-7d18-4c6d-a078-a4a41daa14a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:21.263393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-26781ce0-7d18-4c6d-a078-a4a41daa14a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158746 May 26 13:22:21.264451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 805/1582] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:21 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:22.281182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eee019b2-edf9-4a92-853e-22ad0563ed6b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:22.281798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eee019b2-edf9-4a92-853e-22ad0563ed6b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:22.285097 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:22.290378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eee019b2-edf9-4a92-853e-22ad0563ed6b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:22.290861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eee019b2-edf9-4a92-853e-22ad0563ed6b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:22.291632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eee019b2-edf9-4a92-853e-22ad0563ed6b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:22.292069 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eee019b2-edf9-4a92-853e-22ad0563ed6b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:22.294639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:22.426126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eee019b2-edf9-4a92-853e-22ad0563ed6b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:22.434984 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eee019b2-edf9-4a92-853e-22ad0563ed6b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157602 May 26 13:22:22.435556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 778/1583] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:22 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:23.452178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3082e5da-db40-437f-8143-8c73c63d4160 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:23.452817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3082e5da-db40-437f-8143-8c73c63d4160 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:23.459377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3082e5da-db40-437f-8143-8c73c63d4160 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:23.459835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3082e5da-db40-437f-8143-8c73c63d4160 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:23.460636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3082e5da-db40-437f-8143-8c73c63d4160 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:23.461077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3082e5da-db40-437f-8143-8c73c63d4160 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:23.589303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3082e5da-db40-437f-8143-8c73c63d4160 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:23.597404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3082e5da-db40-437f-8143-8c73c63d4160 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149217 May 26 13:22:23.597977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 806/1584] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:23 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:24.617104 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7d94a16-7947-46e8-91f5-a47765f9ac7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:24.617711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7d94a16-7947-46e8-91f5-a47765f9ac7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:24.624496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7d94a16-7947-46e8-91f5-a47765f9ac7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:24.624936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7d94a16-7947-46e8-91f5-a47765f9ac7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:24.625710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7d94a16-7947-46e8-91f5-a47765f9ac7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:24.626148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7d94a16-7947-46e8-91f5-a47765f9ac7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:24.754900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7d94a16-7947-46e8-91f5-a47765f9ac7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:24.762764 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7d94a16-7947-46e8-91f5-a47765f9ac7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150649 May 26 13:22:24.763327 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 779/1585] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:24 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:25.780511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8cd9704-08d4-46d2-9441-7ef37f3df133 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:25.781147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8cd9704-08d4-46d2-9441-7ef37f3df133 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:25.789057 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8cd9704-08d4-46d2-9441-7ef37f3df133 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:25.789504 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8cd9704-08d4-46d2-9441-7ef37f3df133 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:25.790267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8cd9704-08d4-46d2-9441-7ef37f3df133 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:25.790735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8cd9704-08d4-46d2-9441-7ef37f3df133 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:25.925991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f8cd9704-08d4-46d2-9441-7ef37f3df133 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:25.934721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8cd9704-08d4-46d2-9441-7ef37f3df133 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158005 May 26 13:22:25.935277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 807/1586] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:25 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:26.952084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-69c6698b-4c10-46db-922b-a69ec977d353 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:26.952640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-69c6698b-4c10-46db-922b-a69ec977d353 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:26.960114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c6698b-4c10-46db-922b-a69ec977d353 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:26.960568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c6698b-4c10-46db-922b-a69ec977d353 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:26.961342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c6698b-4c10-46db-922b-a69ec977d353 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:26.961782 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c6698b-4c10-46db-922b-a69ec977d353 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:27.092843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-69c6698b-4c10-46db-922b-a69ec977d353 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:27.101067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-69c6698b-4c10-46db-922b-a69ec977d353 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152931 May 26 13:22:27.101642 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 780/1587] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:26 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:28.118659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-63fe02eb-b81f-41b4-95b6-d359b7e3de13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:28.119216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-63fe02eb-b81f-41b4-95b6-d359b7e3de13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:28.125726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63fe02eb-b81f-41b4-95b6-d359b7e3de13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:28.126183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63fe02eb-b81f-41b4-95b6-d359b7e3de13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:28.126985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63fe02eb-b81f-41b4-95b6-d359b7e3de13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:28.127427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63fe02eb-b81f-41b4-95b6-d359b7e3de13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:28.262108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-63fe02eb-b81f-41b4-95b6-d359b7e3de13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:28.271619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-63fe02eb-b81f-41b4-95b6-d359b7e3de13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156538 May 26 13:22:28.272213 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 808/1588] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:28 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:29.293810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31762703-e030-40a8-afcd-51cd0528c39e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:29.294431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31762703-e030-40a8-afcd-51cd0528c39e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:29.301050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31762703-e030-40a8-afcd-51cd0528c39e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:29.301511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31762703-e030-40a8-afcd-51cd0528c39e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:29.302420 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31762703-e030-40a8-afcd-51cd0528c39e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:29.302875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31762703-e030-40a8-afcd-51cd0528c39e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:29.431290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31762703-e030-40a8-afcd-51cd0528c39e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:29.439240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31762703-e030-40a8-afcd-51cd0528c39e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149401 May 26 13:22:29.439808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 781/1589] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:29 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:30.456743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ba94a2e3-32bc-4eac-bda9-92eff340b215 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:30.457351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ba94a2e3-32bc-4eac-bda9-92eff340b215 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:30.463951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba94a2e3-32bc-4eac-bda9-92eff340b215 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:30.464400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba94a2e3-32bc-4eac-bda9-92eff340b215 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:30.465162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba94a2e3-32bc-4eac-bda9-92eff340b215 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:30.465598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba94a2e3-32bc-4eac-bda9-92eff340b215 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:30.593430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ba94a2e3-32bc-4eac-bda9-92eff340b215 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:30.602679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ba94a2e3-32bc-4eac-bda9-92eff340b215 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149493 May 26 13:22:30.603251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 809/1590] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:30 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:31.620201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1119be3-a2d0-4fa2-a06e-70bdb8dcf013 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:31.620776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1119be3-a2d0-4fa2-a06e-70bdb8dcf013 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:31.627548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1119be3-a2d0-4fa2-a06e-70bdb8dcf013 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:31.627999 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1119be3-a2d0-4fa2-a06e-70bdb8dcf013 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:31.628759 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1119be3-a2d0-4fa2-a06e-70bdb8dcf013 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:31.629200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1119be3-a2d0-4fa2-a06e-70bdb8dcf013 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:31.758520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1119be3-a2d0-4fa2-a06e-70bdb8dcf013 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:31.766411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1119be3-a2d0-4fa2-a06e-70bdb8dcf013 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150241 May 26 13:22:31.767002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 782/1591] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:31 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:32.784232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bbb715a4-d758-47b4-8689-84d0f428ded9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:32.784829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bbb715a4-d758-47b4-8689-84d0f428ded9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:32.791766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbb715a4-d758-47b4-8689-84d0f428ded9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:32.792210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbb715a4-d758-47b4-8689-84d0f428ded9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:32.792966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbb715a4-d758-47b4-8689-84d0f428ded9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:32.793400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbb715a4-d758-47b4-8689-84d0f428ded9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:32.925534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bbb715a4-d758-47b4-8689-84d0f428ded9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:32.934697 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bbb715a4-d758-47b4-8689-84d0f428ded9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154315 May 26 13:22:32.935258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 810/1592] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:32 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:33.951742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5cc58fc3-6631-4fa8-90ec-c36ebed11550 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:33.952351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5cc58fc3-6631-4fa8-90ec-c36ebed11550 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:33.958942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cc58fc3-6631-4fa8-90ec-c36ebed11550 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:33.959393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cc58fc3-6631-4fa8-90ec-c36ebed11550 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:33.960151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cc58fc3-6631-4fa8-90ec-c36ebed11550 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:33.960586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cc58fc3-6631-4fa8-90ec-c36ebed11550 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:34.090514 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5cc58fc3-6631-4fa8-90ec-c36ebed11550 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:34.098446 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5cc58fc3-6631-4fa8-90ec-c36ebed11550 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150549 May 26 13:22:34.099034 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 783/1593] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:33 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:35.115332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e16a684-b91b-41fa-9dea-2cfa23775102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:35.115950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1e16a684-b91b-41fa-9dea-2cfa23775102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:35.122469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e16a684-b91b-41fa-9dea-2cfa23775102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:35.122958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e16a684-b91b-41fa-9dea-2cfa23775102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:35.123725 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e16a684-b91b-41fa-9dea-2cfa23775102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:35.124167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e16a684-b91b-41fa-9dea-2cfa23775102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:35.253783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1e16a684-b91b-41fa-9dea-2cfa23775102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:35.262952 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1e16a684-b91b-41fa-9dea-2cfa23775102 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151620 May 26 13:22:35.263537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 811/1594] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:35 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:36.280191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-be10c58d-b453-47ff-9ed2-593008513030 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:36.280839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-be10c58d-b453-47ff-9ed2-593008513030 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:36.288173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be10c58d-b453-47ff-9ed2-593008513030 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:36.288625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be10c58d-b453-47ff-9ed2-593008513030 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:36.289404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be10c58d-b453-47ff-9ed2-593008513030 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:36.289848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be10c58d-b453-47ff-9ed2-593008513030 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:36.419193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-be10c58d-b453-47ff-9ed2-593008513030 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:36.427323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-be10c58d-b453-47ff-9ed2-593008513030 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150875 May 26 13:22:36.428042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 784/1595] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:36 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:37.445041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ceebb3ca-ecc5-4976-bc70-d9ab56896ca1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:37.445647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ceebb3ca-ecc5-4976-bc70-d9ab56896ca1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:37.452108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceebb3ca-ecc5-4976-bc70-d9ab56896ca1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:37.452557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceebb3ca-ecc5-4976-bc70-d9ab56896ca1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:37.453311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceebb3ca-ecc5-4976-bc70-d9ab56896ca1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:37.453749 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceebb3ca-ecc5-4976-bc70-d9ab56896ca1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:37.592083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ceebb3ca-ecc5-4976-bc70-d9ab56896ca1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:37.601004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ceebb3ca-ecc5-4976-bc70-d9ab56896ca1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.160109 May 26 13:22:37.601563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 812/1596] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:37 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:38.011295 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:22:38.011732 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:22:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:22:38.619259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0bc2c3ea-268d-4ae0-9f0c-27e8a4500b40 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:38.619816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0bc2c3ea-268d-4ae0-9f0c-27e8a4500b40 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:38.626395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bc2c3ea-268d-4ae0-9f0c-27e8a4500b40 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:38.626878 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bc2c3ea-268d-4ae0-9f0c-27e8a4500b40 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:38.627700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bc2c3ea-268d-4ae0-9f0c-27e8a4500b40 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:38.628140 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bc2c3ea-268d-4ae0-9f0c-27e8a4500b40 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:38.761340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0bc2c3ea-268d-4ae0-9f0c-27e8a4500b40 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:38.769273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0bc2c3ea-268d-4ae0-9f0c-27e8a4500b40 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154641 May 26 13:22:38.769829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 785/1597] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:38 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:39.787108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-38673adb-963e-48f3-a6f4-0e679b3fcd93 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:39.787727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-38673adb-963e-48f3-a6f4-0e679b3fcd93 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:39.794206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38673adb-963e-48f3-a6f4-0e679b3fcd93 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:39.794705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38673adb-963e-48f3-a6f4-0e679b3fcd93 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:39.795480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38673adb-963e-48f3-a6f4-0e679b3fcd93 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:39.795933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38673adb-963e-48f3-a6f4-0e679b3fcd93 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:39.921913 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38673adb-963e-48f3-a6f4-0e679b3fcd93 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:39.931119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-38673adb-963e-48f3-a6f4-0e679b3fcd93 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.147979 May 26 13:22:39.931754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 813/1598] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:39 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:40.948685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ed647357-5644-45e8-b3d5-eec44f2e6a13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:40.949299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ed647357-5644-45e8-b3d5-eec44f2e6a13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:40.955866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed647357-5644-45e8-b3d5-eec44f2e6a13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:40.956311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed647357-5644-45e8-b3d5-eec44f2e6a13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:40.957075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed647357-5644-45e8-b3d5-eec44f2e6a13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:40.957508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed647357-5644-45e8-b3d5-eec44f2e6a13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:41.083499 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ed647357-5644-45e8-b3d5-eec44f2e6a13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:41.092471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ed647357-5644-45e8-b3d5-eec44f2e6a13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.147684 May 26 13:22:41.093044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 786/1599] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:40 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:42.109850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-044bc51a-e254-4694-ba9b-3996f8a6adcc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:42.110400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-044bc51a-e254-4694-ba9b-3996f8a6adcc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:42.117882 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-044bc51a-e254-4694-ba9b-3996f8a6adcc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:42.118262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-044bc51a-e254-4694-ba9b-3996f8a6adcc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:42.119030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-044bc51a-e254-4694-ba9b-3996f8a6adcc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:42.119475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-044bc51a-e254-4694-ba9b-3996f8a6adcc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:42.252906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-044bc51a-e254-4694-ba9b-3996f8a6adcc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:42.261569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-044bc51a-e254-4694-ba9b-3996f8a6adcc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155544 May 26 13:22:42.262159 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 814/1600] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:42 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:43.281564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5fa1d490-9da9-4361-bc51-d1ec72cd2f17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:43.282002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5fa1d490-9da9-4361-bc51-d1ec72cd2f17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:43.289304 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fa1d490-9da9-4361-bc51-d1ec72cd2f17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:43.289734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fa1d490-9da9-4361-bc51-d1ec72cd2f17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:43.290577 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fa1d490-9da9-4361-bc51-d1ec72cd2f17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:43.291018 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fa1d490-9da9-4361-bc51-d1ec72cd2f17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:43.420739 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5fa1d490-9da9-4361-bc51-d1ec72cd2f17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:43.429636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5fa1d490-9da9-4361-bc51-d1ec72cd2f17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152164 May 26 13:22:43.430198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 787/1601] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:43 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:44.447912 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb3d6497-ca78-45b1-93d1-cf8d99da1cf0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:44.450652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb3d6497-ca78-45b1-93d1-cf8d99da1cf0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:44.455317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb3d6497-ca78-45b1-93d1-cf8d99da1cf0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:44.455770 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb3d6497-ca78-45b1-93d1-cf8d99da1cf0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:44.456580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb3d6497-ca78-45b1-93d1-cf8d99da1cf0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:44.457026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb3d6497-ca78-45b1-93d1-cf8d99da1cf0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:44.868160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cb3d6497-ca78-45b1-93d1-cf8d99da1cf0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:44.876011 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb3d6497-ca78-45b1-93d1-cf8d99da1cf0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.432695 May 26 13:22:44.876572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 815/1602] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:44 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:44.965595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:22:44.966264 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:22:45.893601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ea46de07-63b9-4902-97b2-fbcb27a694b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:45.894223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ea46de07-63b9-4902-97b2-fbcb27a694b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:45.901658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea46de07-63b9-4902-97b2-fbcb27a694b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:45.902114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea46de07-63b9-4902-97b2-fbcb27a694b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:45.903001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea46de07-63b9-4902-97b2-fbcb27a694b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:45.903438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea46de07-63b9-4902-97b2-fbcb27a694b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:46.032553 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea46de07-63b9-4902-97b2-fbcb27a694b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:46.040460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ea46de07-63b9-4902-97b2-fbcb27a694b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150830 May 26 13:22:46.041020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 788/1603] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:45 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:47.057492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cdaf279c-e99d-43f8-b61d-390be4bb4eca tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:47.058107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cdaf279c-e99d-43f8-b61d-390be4bb4eca tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:47.064727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdaf279c-e99d-43f8-b61d-390be4bb4eca tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:47.065179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdaf279c-e99d-43f8-b61d-390be4bb4eca tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:47.065945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdaf279c-e99d-43f8-b61d-390be4bb4eca tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:47.066385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdaf279c-e99d-43f8-b61d-390be4bb4eca tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:47.192629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cdaf279c-e99d-43f8-b61d-390be4bb4eca tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:47.201220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cdaf279c-e99d-43f8-b61d-390be4bb4eca tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.147673 May 26 13:22:47.201787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 816/1604] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:47 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:48.219731 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-607f94c0-6b83-4995-a3e4-b6fdcb1825d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:48.220378 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-607f94c0-6b83-4995-a3e4-b6fdcb1825d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:48.227999 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-607f94c0-6b83-4995-a3e4-b6fdcb1825d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:48.228454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-607f94c0-6b83-4995-a3e4-b6fdcb1825d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:48.229228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-607f94c0-6b83-4995-a3e4-b6fdcb1825d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:48.229670 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-607f94c0-6b83-4995-a3e4-b6fdcb1825d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:48.368594 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-607f94c0-6b83-4995-a3e4-b6fdcb1825d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:48.376570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-607f94c0-6b83-4995-a3e4-b6fdcb1825d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.160718 May 26 13:22:48.386032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 789/1605] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:48 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:49.393126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b68543dc-0537-4ffc-9b28-55f08d1caf3e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:49.393712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b68543dc-0537-4ffc-9b28-55f08d1caf3e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:49.400364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b68543dc-0537-4ffc-9b28-55f08d1caf3e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:49.400810 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b68543dc-0537-4ffc-9b28-55f08d1caf3e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:49.401569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b68543dc-0537-4ffc-9b28-55f08d1caf3e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:49.402030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b68543dc-0537-4ffc-9b28-55f08d1caf3e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:49.535721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b68543dc-0537-4ffc-9b28-55f08d1caf3e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:49.544417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b68543dc-0537-4ffc-9b28-55f08d1caf3e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155181 May 26 13:22:49.544984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 817/1606] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:49 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:50.561653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9003305-a783-42c8-9866-244e5baa0d2f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:50.562222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9003305-a783-42c8-9866-244e5baa0d2f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:50.569039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9003305-a783-42c8-9866-244e5baa0d2f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:50.569531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9003305-a783-42c8-9866-244e5baa0d2f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:50.570485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9003305-a783-42c8-9866-244e5baa0d2f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:50.570958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9003305-a783-42c8-9866-244e5baa0d2f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:50.701575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9003305-a783-42c8-9866-244e5baa0d2f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:50.709421 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9003305-a783-42c8-9866-244e5baa0d2f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151895 May 26 13:22:50.709967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 790/1607] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:50 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:51.726766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7ee5b980-7d14-47a1-9e4b-e8a7589984f3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:51.727638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7ee5b980-7d14-47a1-9e4b-e8a7589984f3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:51.729965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:51.734780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ee5b980-7d14-47a1-9e4b-e8a7589984f3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:51.735236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ee5b980-7d14-47a1-9e4b-e8a7589984f3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:51.735996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ee5b980-7d14-47a1-9e4b-e8a7589984f3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:51.736527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ee5b980-7d14-47a1-9e4b-e8a7589984f3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:51.739173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:51.868677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7ee5b980-7d14-47a1-9e4b-e8a7589984f3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:51.876548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7ee5b980-7d14-47a1-9e4b-e8a7589984f3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153877 May 26 13:22:51.877118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 818/1608] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:51 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:52.894606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb9fddb4-f130-4442-83a8-da95d2059385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:52.895219 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb9fddb4-f130-4442-83a8-da95d2059385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:52.898148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:52.902976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb9fddb4-f130-4442-83a8-da95d2059385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:52.903432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb9fddb4-f130-4442-83a8-da95d2059385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:52.904210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb9fddb4-f130-4442-83a8-da95d2059385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:52.904657 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb9fddb4-f130-4442-83a8-da95d2059385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:52.907268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:53.033433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb9fddb4-f130-4442-83a8-da95d2059385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:53.041356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb9fddb4-f130-4442-83a8-da95d2059385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151290 May 26 13:22:53.041910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 791/1609] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:52 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:54.059015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf83c6c5-dc56-4f97-8ff1-cc957b7d3d28 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:54.059570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf83c6c5-dc56-4f97-8ff1-cc957b7d3d28 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:54.065621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf83c6c5-dc56-4f97-8ff1-cc957b7d3d28 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:54.066076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf83c6c5-dc56-4f97-8ff1-cc957b7d3d28 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:54.066931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf83c6c5-dc56-4f97-8ff1-cc957b7d3d28 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:54.067368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf83c6c5-dc56-4f97-8ff1-cc957b7d3d28 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:54.197580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf83c6c5-dc56-4f97-8ff1-cc957b7d3d28 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:54.205522 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf83c6c5-dc56-4f97-8ff1-cc957b7d3d28 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150769 May 26 13:22:54.206097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 819/1610] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:54 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:22:55.223527 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9cad0a60-fa64-4c34-9032-7051a7cd7e60 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:55.224666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9cad0a60-fa64-4c34-9032-7051a7cd7e60 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:55.231808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cad0a60-fa64-4c34-9032-7051a7cd7e60 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:55.232265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cad0a60-fa64-4c34-9032-7051a7cd7e60 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:55.233078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cad0a60-fa64-4c34-9032-7051a7cd7e60 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:55.233517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cad0a60-fa64-4c34-9032-7051a7cd7e60 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:55.373212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9cad0a60-fa64-4c34-9032-7051a7cd7e60 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:55.381459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9cad0a60-fa64-4c34-9032-7051a7cd7e60 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.161794 May 26 13:22:55.382027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 792/1611] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:55 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:56.399565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7bd97c55-4526-4d77-8e8d-38c62deeff58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:56.400190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7bd97c55-4526-4d77-8e8d-38c62deeff58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:56.406699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bd97c55-4526-4d77-8e8d-38c62deeff58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:56.407160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bd97c55-4526-4d77-8e8d-38c62deeff58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:56.407935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bd97c55-4526-4d77-8e8d-38c62deeff58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:56.408766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bd97c55-4526-4d77-8e8d-38c62deeff58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:56.538658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7bd97c55-4526-4d77-8e8d-38c62deeff58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:56.547064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7bd97c55-4526-4d77-8e8d-38c62deeff58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152097 May 26 13:22:56.547636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 820/1612] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:56 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:57.564478 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bee85f2d-8ef2-4fd0-bec5-5a8eb16903b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:57.565093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bee85f2d-8ef2-4fd0-bec5-5a8eb16903b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:57.571750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bee85f2d-8ef2-4fd0-bec5-5a8eb16903b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:57.572200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bee85f2d-8ef2-4fd0-bec5-5a8eb16903b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:57.572967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bee85f2d-8ef2-4fd0-bec5-5a8eb16903b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:57.573402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bee85f2d-8ef2-4fd0-bec5-5a8eb16903b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:57.710786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bee85f2d-8ef2-4fd0-bec5-5a8eb16903b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:57.718650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bee85f2d-8ef2-4fd0-bec5-5a8eb16903b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158055 May 26 13:22:57.719207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 793/1613] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:57 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:58.736596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20424996-e105-47d1-b873-c26584e09f77 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:58.737227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-20424996-e105-47d1-b873-c26584e09f77 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:58.744851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20424996-e105-47d1-b873-c26584e09f77 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:58.745306 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20424996-e105-47d1-b873-c26584e09f77 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:58.746074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20424996-e105-47d1-b873-c26584e09f77 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:58.746515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20424996-e105-47d1-b873-c26584e09f77 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:58.878022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20424996-e105-47d1-b873-c26584e09f77 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:22:58.886220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-20424996-e105-47d1-b873-c26584e09f77 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153511 May 26 13:22:58.886821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 821/1614] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:58 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:22:59.904203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b4e1de6d-0006-4471-adf1-082ae1714543 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:22:59.904826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b4e1de6d-0006-4471-adf1-082ae1714543 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:22:59.911403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4e1de6d-0006-4471-adf1-082ae1714543 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:59.911860 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4e1de6d-0006-4471-adf1-082ae1714543 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:22:59.912757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4e1de6d-0006-4471-adf1-082ae1714543 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:22:59.913282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4e1de6d-0006-4471-adf1-082ae1714543 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:00.044251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4e1de6d-0006-4471-adf1-082ae1714543 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:00.052329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b4e1de6d-0006-4471-adf1-082ae1714543 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152008 May 26 13:23:00.053455 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 794/1615] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:22:59 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:01.070792 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-424de8b9-b3f8-4085-a8c9-8d4b632ed94f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:01.071451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-424de8b9-b3f8-4085-a8c9-8d4b632ed94f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:01.080834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-424de8b9-b3f8-4085-a8c9-8d4b632ed94f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:01.081287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-424de8b9-b3f8-4085-a8c9-8d4b632ed94f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:01.082666 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-424de8b9-b3f8-4085-a8c9-8d4b632ed94f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:01.082816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-424de8b9-b3f8-4085-a8c9-8d4b632ed94f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:01.224141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-424de8b9-b3f8-4085-a8c9-8d4b632ed94f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:01.232585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-424de8b9-b3f8-4085-a8c9-8d4b632ed94f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.165979 May 26 13:23:01.233178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 822/1616] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:01 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:02.249310 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ec9689c0-52b1-4858-be7c-2ea86c535f69 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:02.249847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ec9689c0-52b1-4858-be7c-2ea86c535f69 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:02.257000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec9689c0-52b1-4858-be7c-2ea86c535f69 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:02.257456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec9689c0-52b1-4858-be7c-2ea86c535f69 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:02.258239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec9689c0-52b1-4858-be7c-2ea86c535f69 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:02.258713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec9689c0-52b1-4858-be7c-2ea86c535f69 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:02.387204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec9689c0-52b1-4858-be7c-2ea86c535f69 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:02.394785 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ec9689c0-52b1-4858-be7c-2ea86c535f69 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149413 May 26 13:23:02.395351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 795/1617] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:02 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:03.412042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df37c0b6-7df5-4da1-9629-4c1a314eba56 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:03.412718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df37c0b6-7df5-4da1-9629-4c1a314eba56 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:03.419248 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df37c0b6-7df5-4da1-9629-4c1a314eba56 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:03.419712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df37c0b6-7df5-4da1-9629-4c1a314eba56 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:03.420486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df37c0b6-7df5-4da1-9629-4c1a314eba56 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:03.420930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df37c0b6-7df5-4da1-9629-4c1a314eba56 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:03.556980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df37c0b6-7df5-4da1-9629-4c1a314eba56 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:03.564955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df37c0b6-7df5-4da1-9629-4c1a314eba56 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156805 May 26 13:23:03.569003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 823/1618] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:03 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:04.583055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ecc68ea1-aea5-44bd-bef2-125979ab594c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:04.583614 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ecc68ea1-aea5-44bd-bef2-125979ab594c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:04.590840 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ecc68ea1-aea5-44bd-bef2-125979ab594c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:04.591288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ecc68ea1-aea5-44bd-bef2-125979ab594c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:04.592056 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ecc68ea1-aea5-44bd-bef2-125979ab594c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:04.592495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ecc68ea1-aea5-44bd-bef2-125979ab594c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:04.721198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ecc68ea1-aea5-44bd-bef2-125979ab594c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:04.735524 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ecc68ea1-aea5-44bd-bef2-125979ab594c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150930 May 26 13:23:04.735524 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 796/1619] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:04 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:05.750994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e0b6d5b-4a30-438f-87e4-b8214205a222 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:05.751614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1e0b6d5b-4a30-438f-87e4-b8214205a222 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:05.758674 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e0b6d5b-4a30-438f-87e4-b8214205a222 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:05.758951 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e0b6d5b-4a30-438f-87e4-b8214205a222 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:05.759730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e0b6d5b-4a30-438f-87e4-b8214205a222 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:05.760172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e0b6d5b-4a30-438f-87e4-b8214205a222 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:05.890320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1e0b6d5b-4a30-438f-87e4-b8214205a222 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:05.898429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1e0b6d5b-4a30-438f-87e4-b8214205a222 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151322 May 26 13:23:05.899024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 824/1620] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:05 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:06.916686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-60610097-b361-4479-af74-abedee0188db tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:06.917302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-60610097-b361-4479-af74-abedee0188db tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:06.923833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60610097-b361-4479-af74-abedee0188db tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:06.924280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60610097-b361-4479-af74-abedee0188db tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:06.925041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60610097-b361-4479-af74-abedee0188db tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:06.925480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60610097-b361-4479-af74-abedee0188db tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:07.056143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-60610097-b361-4479-af74-abedee0188db tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:07.064063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-60610097-b361-4479-af74-abedee0188db tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151861 May 26 13:23:07.064620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 797/1621] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:06 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:08.081140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e5a068f8-40f6-40d6-af84-e3b1a26fe422 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:08.081672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e5a068f8-40f6-40d6-af84-e3b1a26fe422 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:08.089107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5a068f8-40f6-40d6-af84-e3b1a26fe422 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:08.089552 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5a068f8-40f6-40d6-af84-e3b1a26fe422 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:08.090312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5a068f8-40f6-40d6-af84-e3b1a26fe422 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:08.090773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5a068f8-40f6-40d6-af84-e3b1a26fe422 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:08.217818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e5a068f8-40f6-40d6-af84-e3b1a26fe422 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:08.226620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e5a068f8-40f6-40d6-af84-e3b1a26fe422 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149301 May 26 13:23:08.227453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 825/1622] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:08 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:09.244667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a017294b-adfa-4a97-9bea-640783dc2477 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:09.245266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a017294b-adfa-4a97-9bea-640783dc2477 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:09.251829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a017294b-adfa-4a97-9bea-640783dc2477 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:09.252274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a017294b-adfa-4a97-9bea-640783dc2477 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:09.253107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a017294b-adfa-4a97-9bea-640783dc2477 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:09.253541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a017294b-adfa-4a97-9bea-640783dc2477 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:09.384780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a017294b-adfa-4a97-9bea-640783dc2477 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:09.392824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a017294b-adfa-4a97-9bea-640783dc2477 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152642 May 26 13:23:09.393385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 798/1623] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:09 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:10.409243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-205eb3a0-c370-464a-821b-3eb17ed02b17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:10.409894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-205eb3a0-c370-464a-821b-3eb17ed02b17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:10.417418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-205eb3a0-c370-464a-821b-3eb17ed02b17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:10.417874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-205eb3a0-c370-464a-821b-3eb17ed02b17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:10.418672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-205eb3a0-c370-464a-821b-3eb17ed02b17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:10.419121 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-205eb3a0-c370-464a-821b-3eb17ed02b17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:10.550230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-205eb3a0-c370-464a-821b-3eb17ed02b17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:10.558298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-205eb3a0-c370-464a-821b-3eb17ed02b17 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153004 May 26 13:23:10.558902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 826/1624] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:10 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:11.575673 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9c5bd0f6-0954-4d86-82d5-8f491ef46d85 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:11.576282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9c5bd0f6-0954-4d86-82d5-8f491ef46d85 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:11.583063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c5bd0f6-0954-4d86-82d5-8f491ef46d85 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:11.583562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c5bd0f6-0954-4d86-82d5-8f491ef46d85 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:11.591358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c5bd0f6-0954-4d86-82d5-8f491ef46d85 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:11.591358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c5bd0f6-0954-4d86-82d5-8f491ef46d85 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:11.736482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c5bd0f6-0954-4d86-82d5-8f491ef46d85 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:11.745021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9c5bd0f6-0954-4d86-82d5-8f491ef46d85 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.173168 May 26 13:23:11.745583 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 799/1625] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:11 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:12.762658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-07363005-9ba7-4c1f-b2cf-ac8abf921e18 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:12.763770 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-07363005-9ba7-4c1f-b2cf-ac8abf921e18 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:12.769982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07363005-9ba7-4c1f-b2cf-ac8abf921e18 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:12.770493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07363005-9ba7-4c1f-b2cf-ac8abf921e18 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:12.771364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07363005-9ba7-4c1f-b2cf-ac8abf921e18 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:12.772127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07363005-9ba7-4c1f-b2cf-ac8abf921e18 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:12.989777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07363005-9ba7-4c1f-b2cf-ac8abf921e18 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:13.004513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-07363005-9ba7-4c1f-b2cf-ac8abf921e18 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.245629 May 26 13:23:13.005231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 827/1626] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:12 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:14.021972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e0212d99-d191-4e9b-800b-22a1cbc007fc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:14.022610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e0212d99-d191-4e9b-800b-22a1cbc007fc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:14.029421 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0212d99-d191-4e9b-800b-22a1cbc007fc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:14.029871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0212d99-d191-4e9b-800b-22a1cbc007fc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:14.030908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0212d99-d191-4e9b-800b-22a1cbc007fc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:14.031766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0212d99-d191-4e9b-800b-22a1cbc007fc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:14.162958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e0212d99-d191-4e9b-800b-22a1cbc007fc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:14.170954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e0212d99-d191-4e9b-800b-22a1cbc007fc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152819 May 26 13:23:14.171517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 800/1627] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:14 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:15.188663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-96673adf-52ff-45ad-8c76-24596ec92e36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:15.189339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-96673adf-52ff-45ad-8c76-24596ec92e36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:15.196559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96673adf-52ff-45ad-8c76-24596ec92e36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:15.197001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96673adf-52ff-45ad-8c76-24596ec92e36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:15.197763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96673adf-52ff-45ad-8c76-24596ec92e36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:15.198194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96673adf-52ff-45ad-8c76-24596ec92e36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:15.340994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-96673adf-52ff-45ad-8c76-24596ec92e36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:15.349081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-96673adf-52ff-45ad-8c76-24596ec92e36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.164313 May 26 13:23:15.350247 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 828/1628] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:15 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:16.367925 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4fe7b854-7fa2-4be1-8c7c-3cc9b46cec01 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:16.368501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4fe7b854-7fa2-4be1-8c7c-3cc9b46cec01 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:16.375203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fe7b854-7fa2-4be1-8c7c-3cc9b46cec01 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:16.375650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fe7b854-7fa2-4be1-8c7c-3cc9b46cec01 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:16.376810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fe7b854-7fa2-4be1-8c7c-3cc9b46cec01 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:16.377243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fe7b854-7fa2-4be1-8c7c-3cc9b46cec01 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:16.504651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4fe7b854-7fa2-4be1-8c7c-3cc9b46cec01 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:16.512868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4fe7b854-7fa2-4be1-8c7c-3cc9b46cec01 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149474 May 26 13:23:16.513459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 801/1629] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:16 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:17.531103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f244412-fa85-4102-b55c-d60e945c40f4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:17.531780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f244412-fa85-4102-b55c-d60e945c40f4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:17.539640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f244412-fa85-4102-b55c-d60e945c40f4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:17.540088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f244412-fa85-4102-b55c-d60e945c40f4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:17.541094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f244412-fa85-4102-b55c-d60e945c40f4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:17.541531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f244412-fa85-4102-b55c-d60e945c40f4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:17.681210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f244412-fa85-4102-b55c-d60e945c40f4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:17.689390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f244412-fa85-4102-b55c-d60e945c40f4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.162176 May 26 13:23:17.690515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 829/1630] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:17 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:18.707662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b4f72d2-9307-4302-90b9-5213cb122ec5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:18.708218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b4f72d2-9307-4302-90b9-5213cb122ec5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:18.715512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b4f72d2-9307-4302-90b9-5213cb122ec5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:18.724222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b4f72d2-9307-4302-90b9-5213cb122ec5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:18.724222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b4f72d2-9307-4302-90b9-5213cb122ec5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:18.724222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b4f72d2-9307-4302-90b9-5213cb122ec5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:18.854050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b4f72d2-9307-4302-90b9-5213cb122ec5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:18.862176 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b4f72d2-9307-4302-90b9-5213cb122ec5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158504 May 26 13:23:18.862786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 802/1631] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:18 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:19.879758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb164a43-9873-4d4f-b23e-79e86858f9a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:19.880359 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb164a43-9873-4d4f-b23e-79e86858f9a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:19.887026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb164a43-9873-4d4f-b23e-79e86858f9a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:19.887471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb164a43-9873-4d4f-b23e-79e86858f9a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:19.888236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb164a43-9873-4d4f-b23e-79e86858f9a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:19.888665 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb164a43-9873-4d4f-b23e-79e86858f9a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:20.022847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb164a43-9873-4d4f-b23e-79e86858f9a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:20.031250 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb164a43-9873-4d4f-b23e-79e86858f9a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155367 May 26 13:23:20.031827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 830/1632] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:19 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:21.048813 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e4c57f54-37b3-4267-bb7b-92ef3c469eef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:21.049427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e4c57f54-37b3-4267-bb7b-92ef3c469eef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:21.056168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4c57f54-37b3-4267-bb7b-92ef3c469eef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:21.056619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4c57f54-37b3-4267-bb7b-92ef3c469eef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:21.057385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4c57f54-37b3-4267-bb7b-92ef3c469eef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:21.057825 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4c57f54-37b3-4267-bb7b-92ef3c469eef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:21.187520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e4c57f54-37b3-4267-bb7b-92ef3c469eef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:21.196345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e4c57f54-37b3-4267-bb7b-92ef3c469eef tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151776 May 26 13:23:21.196913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 803/1633] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:21 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:22.214074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b0c032c-3fe2-478f-8bc1-b6b83d904a76 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:22.214728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b0c032c-3fe2-478f-8bc1-b6b83d904a76 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:22.217077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:23:22.221982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0c032c-3fe2-478f-8bc1-b6b83d904a76 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:22.229836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0c032c-3fe2-478f-8bc1-b6b83d904a76 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:22.229836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0c032c-3fe2-478f-8bc1-b6b83d904a76 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:22.229836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0c032c-3fe2-478f-8bc1-b6b83d904a76 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:22.229836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:23:22.370080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b0c032c-3fe2-478f-8bc1-b6b83d904a76 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:22.378105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b0c032c-3fe2-478f-8bc1-b6b83d904a76 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.168481 May 26 13:23:22.378698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 831/1634] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:22 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:23.395843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2268e6b-3181-49b1-918c-46e275c14e21 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:23.396432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2268e6b-3181-49b1-918c-46e275c14e21 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:23.399508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:23:23.404288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2268e6b-3181-49b1-918c-46e275c14e21 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:23.404735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2268e6b-3181-49b1-918c-46e275c14e21 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:23.405542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2268e6b-3181-49b1-918c-46e275c14e21 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:23.405980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2268e6b-3181-49b1-918c-46e275c14e21 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:23.408571 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:23:23.791063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2268e6b-3181-49b1-918c-46e275c14e21 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:23.798915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2268e6b-3181-49b1-918c-46e275c14e21 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.406921 May 26 13:23:23.799474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 804/1635] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:23 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:24.816766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-225aa30c-2d85-4384-b263-a63ae738d7c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:24.817387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-225aa30c-2d85-4384-b263-a63ae738d7c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:24.824590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-225aa30c-2d85-4384-b263-a63ae738d7c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:24.825047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-225aa30c-2d85-4384-b263-a63ae738d7c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:24.825827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-225aa30c-2d85-4384-b263-a63ae738d7c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:24.826278 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-225aa30c-2d85-4384-b263-a63ae738d7c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:24.960648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-225aa30c-2d85-4384-b263-a63ae738d7c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:24.968708 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-225aa30c-2d85-4384-b263-a63ae738d7c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156049 May 26 13:23:24.969286 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 832/1636] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:24 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:25.987114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b27b0578-45bb-4183-ab32-d152a5344286 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:25.987735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b27b0578-45bb-4183-ab32-d152a5344286 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:25.995529 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b27b0578-45bb-4183-ab32-d152a5344286 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:25.995983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b27b0578-45bb-4183-ab32-d152a5344286 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:25.996765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b27b0578-45bb-4183-ab32-d152a5344286 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:25.997204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b27b0578-45bb-4183-ab32-d152a5344286 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:26.128483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b27b0578-45bb-4183-ab32-d152a5344286 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:26.136758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b27b0578-45bb-4183-ab32-d152a5344286 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153434 May 26 13:23:26.137332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 805/1637] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:25 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:27.154193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b26f5b2a-e150-4ae5-b23e-27637e62d5a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:27.154847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b26f5b2a-e150-4ae5-b23e-27637e62d5a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:27.161414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b26f5b2a-e150-4ae5-b23e-27637e62d5a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:27.161854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b26f5b2a-e150-4ae5-b23e-27637e62d5a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:27.162679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b26f5b2a-e150-4ae5-b23e-27637e62d5a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:27.163105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b26f5b2a-e150-4ae5-b23e-27637e62d5a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:27.300957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b26f5b2a-e150-4ae5-b23e-27637e62d5a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:27.309513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b26f5b2a-e150-4ae5-b23e-27637e62d5a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.159869 May 26 13:23:27.310068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 833/1638] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:27 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:28.327296 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d53d165-5482-4af2-ba2a-4cb558d12001 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:28.327922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d53d165-5482-4af2-ba2a-4cb558d12001 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:28.334805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d53d165-5482-4af2-ba2a-4cb558d12001 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:28.335265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d53d165-5482-4af2-ba2a-4cb558d12001 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:28.336039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d53d165-5482-4af2-ba2a-4cb558d12001 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:28.336494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d53d165-5482-4af2-ba2a-4cb558d12001 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:28.476496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d53d165-5482-4af2-ba2a-4cb558d12001 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:28.484783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d53d165-5482-4af2-ba2a-4cb558d12001 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.161390 May 26 13:23:28.485351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 806/1639] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:28 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:29.501744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94c5af9b-a104-4d4b-b9a1-b97a653138b3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:29.502352 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-94c5af9b-a104-4d4b-b9a1-b97a653138b3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:29.509883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94c5af9b-a104-4d4b-b9a1-b97a653138b3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:29.510346 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94c5af9b-a104-4d4b-b9a1-b97a653138b3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:29.511162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94c5af9b-a104-4d4b-b9a1-b97a653138b3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:29.511614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94c5af9b-a104-4d4b-b9a1-b97a653138b3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:29.643593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94c5af9b-a104-4d4b-b9a1-b97a653138b3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:29.651664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94c5af9b-a104-4d4b-b9a1-b97a653138b3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153788 May 26 13:23:29.652234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 834/1640] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:29 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:30.668898 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff8442d2-f269-46c0-8388-fa1772e1b569 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:30.669556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff8442d2-f269-46c0-8388-fa1772e1b569 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:30.677868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff8442d2-f269-46c0-8388-fa1772e1b569 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:30.678385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff8442d2-f269-46c0-8388-fa1772e1b569 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:30.679719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff8442d2-f269-46c0-8388-fa1772e1b569 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:30.680157 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff8442d2-f269-46c0-8388-fa1772e1b569 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:30.814870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff8442d2-f269-46c0-8388-fa1772e1b569 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:30.820552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff8442d2-f269-46c0-8388-fa1772e1b569 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155007 May 26 13:23:30.821122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 807/1641] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:30 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:31.837965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b8cb9d88-7250-4983-8d9b-f10fb75c5702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:31.838663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b8cb9d88-7250-4983-8d9b-f10fb75c5702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:31.845447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8cb9d88-7250-4983-8d9b-f10fb75c5702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:31.845896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8cb9d88-7250-4983-8d9b-f10fb75c5702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:31.846679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8cb9d88-7250-4983-8d9b-f10fb75c5702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:31.847115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8cb9d88-7250-4983-8d9b-f10fb75c5702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:31.984562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b8cb9d88-7250-4983-8d9b-f10fb75c5702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:31.993321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b8cb9d88-7250-4983-8d9b-f10fb75c5702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.159916 May 26 13:23:31.993893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 835/1642] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:31 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:23:33.012782 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1c72f137-9e26-47e0-8447-6636be2b6f41 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:33.013649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1c72f137-9e26-47e0-8447-6636be2b6f41 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:33.021015 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c72f137-9e26-47e0-8447-6636be2b6f41 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:33.021503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c72f137-9e26-47e0-8447-6636be2b6f41 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:33.022598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c72f137-9e26-47e0-8447-6636be2b6f41 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:33.023086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c72f137-9e26-47e0-8447-6636be2b6f41 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:33.148736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1c72f137-9e26-47e0-8447-6636be2b6f41 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:33.156588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1c72f137-9e26-47e0-8447-6636be2b6f41 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149207 May 26 13:23:33.157150 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 808/1643] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:33 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:34.173786 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-104f6471-6cc5-4305-949e-25e5d990f355 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:34.174408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-104f6471-6cc5-4305-949e-25e5d990f355 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:34.181584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-104f6471-6cc5-4305-949e-25e5d990f355 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:34.182038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-104f6471-6cc5-4305-949e-25e5d990f355 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:34.182926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-104f6471-6cc5-4305-949e-25e5d990f355 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:34.183369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-104f6471-6cc5-4305-949e-25e5d990f355 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:34.318545 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-104f6471-6cc5-4305-949e-25e5d990f355 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:34.326670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-104f6471-6cc5-4305-949e-25e5d990f355 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156838 May 26 13:23:34.327245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 836/1644] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:34 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:35.344019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b7b9b8d-2018-4e38-8efc-2c0713beb909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:35.344630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b7b9b8d-2018-4e38-8efc-2c0713beb909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:35.351348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b7b9b8d-2018-4e38-8efc-2c0713beb909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:35.351796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b7b9b8d-2018-4e38-8efc-2c0713beb909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:35.352805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b7b9b8d-2018-4e38-8efc-2c0713beb909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:35.353239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b7b9b8d-2018-4e38-8efc-2c0713beb909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:35.486167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b7b9b8d-2018-4e38-8efc-2c0713beb909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:35.494872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b7b9b8d-2018-4e38-8efc-2c0713beb909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154669 May 26 13:23:35.495432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 809/1645] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:35 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:36.512298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be9500f6-d412-4c2e-9893-8850dcfeabd4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:36.512908 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be9500f6-d412-4c2e-9893-8850dcfeabd4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:36.519365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be9500f6-d412-4c2e-9893-8850dcfeabd4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:36.519814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be9500f6-d412-4c2e-9893-8850dcfeabd4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:36.520573 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be9500f6-d412-4c2e-9893-8850dcfeabd4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:36.521009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be9500f6-d412-4c2e-9893-8850dcfeabd4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:36.649493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be9500f6-d412-4c2e-9893-8850dcfeabd4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:36.657820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be9500f6-d412-4c2e-9893-8850dcfeabd4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149446 May 26 13:23:36.658379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 837/1646] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:36 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:37.674445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-826cd853-7767-4498-8566-9ce9301d3677 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:37.675149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-826cd853-7767-4498-8566-9ce9301d3677 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:37.681931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-826cd853-7767-4498-8566-9ce9301d3677 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:37.682382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-826cd853-7767-4498-8566-9ce9301d3677 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:37.683179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-826cd853-7767-4498-8566-9ce9301d3677 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:37.683624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-826cd853-7767-4498-8566-9ce9301d3677 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:37.809197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-826cd853-7767-4498-8566-9ce9301d3677 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:37.817192 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-826cd853-7767-4498-8566-9ce9301d3677 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.146528 May 26 13:23:37.817780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 810/1647] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:37 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:38.835116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f01502a3-1ee6-4611-855e-862613a70646 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:38.835738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f01502a3-1ee6-4611-855e-862613a70646 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:38.842234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f01502a3-1ee6-4611-855e-862613a70646 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:38.842721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f01502a3-1ee6-4611-855e-862613a70646 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:38.843491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f01502a3-1ee6-4611-855e-862613a70646 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:38.843932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f01502a3-1ee6-4611-855e-862613a70646 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:38.979253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f01502a3-1ee6-4611-855e-862613a70646 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:38.987405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f01502a3-1ee6-4611-855e-862613a70646 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156553 May 26 13:23:38.987975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 838/1648] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:38 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:40.005295 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7306446b-3c00-407d-9a00-3838fa83e743 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:40.005847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7306446b-3c00-407d-9a00-3838fa83e743 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:40.012851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7306446b-3c00-407d-9a00-3838fa83e743 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:40.013302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7306446b-3c00-407d-9a00-3838fa83e743 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:40.014284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7306446b-3c00-407d-9a00-3838fa83e743 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:40.014755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7306446b-3c00-407d-9a00-3838fa83e743 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:40.145448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7306446b-3c00-407d-9a00-3838fa83e743 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:40.153495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7306446b-3c00-407d-9a00-3838fa83e743 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152171 May 26 13:23:40.154050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 811/1649] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:40 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:41.171151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a6db1f24-e52d-4b18-8aea-aa1014b52844 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:41.171777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a6db1f24-e52d-4b18-8aea-aa1014b52844 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:41.178446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6db1f24-e52d-4b18-8aea-aa1014b52844 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:41.178983 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6db1f24-e52d-4b18-8aea-aa1014b52844 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:41.179749 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6db1f24-e52d-4b18-8aea-aa1014b52844 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:41.180190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6db1f24-e52d-4b18-8aea-aa1014b52844 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:41.311418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a6db1f24-e52d-4b18-8aea-aa1014b52844 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:41.320439 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a6db1f24-e52d-4b18-8aea-aa1014b52844 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153137 May 26 13:23:41.321008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 839/1650] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:41 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:42.337924 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-25f01c50-f59c-4e3e-aca0-6e7bb3ae3ab9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:42.338559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-25f01c50-f59c-4e3e-aca0-6e7bb3ae3ab9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:42.345024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25f01c50-f59c-4e3e-aca0-6e7bb3ae3ab9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:42.345483 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25f01c50-f59c-4e3e-aca0-6e7bb3ae3ab9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:42.346251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25f01c50-f59c-4e3e-aca0-6e7bb3ae3ab9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:42.346719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25f01c50-f59c-4e3e-aca0-6e7bb3ae3ab9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:42.476066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25f01c50-f59c-4e3e-aca0-6e7bb3ae3ab9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:42.484320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-25f01c50-f59c-4e3e-aca0-6e7bb3ae3ab9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150977 May 26 13:23:42.484883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 812/1651] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:42 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:43.501656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dfeb6132-80ab-4bfa-b8ed-2634fb54f911 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:43.502271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dfeb6132-80ab-4bfa-b8ed-2634fb54f911 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:43.509722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfeb6132-80ab-4bfa-b8ed-2634fb54f911 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:43.510169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfeb6132-80ab-4bfa-b8ed-2634fb54f911 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:43.510977 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfeb6132-80ab-4bfa-b8ed-2634fb54f911 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:43.511418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfeb6132-80ab-4bfa-b8ed-2634fb54f911 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:43.646902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dfeb6132-80ab-4bfa-b8ed-2634fb54f911 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:43.656039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dfeb6132-80ab-4bfa-b8ed-2634fb54f911 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158284 May 26 13:23:43.656612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 840/1652] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:43 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:44.674655 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7b306c38-2005-40fc-a1b5-9e3916f5dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:44.675276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7b306c38-2005-40fc-a1b5-9e3916f5dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:44.682398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b306c38-2005-40fc-a1b5-9e3916f5dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:44.682895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b306c38-2005-40fc-a1b5-9e3916f5dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:44.684128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b306c38-2005-40fc-a1b5-9e3916f5dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:44.684848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b306c38-2005-40fc-a1b5-9e3916f5dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:44.819038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7b306c38-2005-40fc-a1b5-9e3916f5dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:44.827607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7b306c38-2005-40fc-a1b5-9e3916f5dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156895 May 26 13:23:44.828181 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 813/1653] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:44 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:45.845914 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a2310ff-80ad-4cea-8851-93e7bbdc6f38 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:45.846639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a2310ff-80ad-4cea-8851-93e7bbdc6f38 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:45.854440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a2310ff-80ad-4cea-8851-93e7bbdc6f38 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:45.854927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a2310ff-80ad-4cea-8851-93e7bbdc6f38 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:45.855705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a2310ff-80ad-4cea-8851-93e7bbdc6f38 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:45.856151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a2310ff-80ad-4cea-8851-93e7bbdc6f38 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:45.991707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a2310ff-80ad-4cea-8851-93e7bbdc6f38 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:45.999863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a2310ff-80ad-4cea-8851-93e7bbdc6f38 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158023 May 26 13:23:46.000434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 841/1654] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:45 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:47.017143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d757af1-430f-4153-817c-cc7f527fc082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:47.017757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d757af1-430f-4153-817c-cc7f527fc082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:47.024424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d757af1-430f-4153-817c-cc7f527fc082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:47.024873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d757af1-430f-4153-817c-cc7f527fc082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:47.025635 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d757af1-430f-4153-817c-cc7f527fc082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:47.026071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d757af1-430f-4153-817c-cc7f527fc082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:47.153515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d757af1-430f-4153-817c-cc7f527fc082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:47.161577 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d757af1-430f-4153-817c-cc7f527fc082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.148200 May 26 13:23:47.162077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 814/1655] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:47 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:23:48.179181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9392834-107f-4d7a-91d4-0062f4b597b5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:48.179793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9392834-107f-4d7a-91d4-0062f4b597b5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:48.187004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9392834-107f-4d7a-91d4-0062f4b597b5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:48.187458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9392834-107f-4d7a-91d4-0062f4b597b5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:48.188237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9392834-107f-4d7a-91d4-0062f4b597b5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:48.188682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9392834-107f-4d7a-91d4-0062f4b597b5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:48.323609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9392834-107f-4d7a-91d4-0062f4b597b5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:48.331670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9392834-107f-4d7a-91d4-0062f4b597b5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156410 May 26 13:23:48.332235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 842/1656] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:48 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:49.349446 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d7fb6b6-6e6e-4cc2-9acd-4ca3528e5762 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:49.350066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d7fb6b6-6e6e-4cc2-9acd-4ca3528e5762 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:49.357369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d7fb6b6-6e6e-4cc2-9acd-4ca3528e5762 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:49.357823 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d7fb6b6-6e6e-4cc2-9acd-4ca3528e5762 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:49.358693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d7fb6b6-6e6e-4cc2-9acd-4ca3528e5762 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:49.359135 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d7fb6b6-6e6e-4cc2-9acd-4ca3528e5762 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:49.491150 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d7fb6b6-6e6e-4cc2-9acd-4ca3528e5762 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:49.499662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d7fb6b6-6e6e-4cc2-9acd-4ca3528e5762 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154152 May 26 13:23:49.500233 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 815/1657] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:49 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:50.516328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1ded0aa7-ed07-4aea-9d12-9f10b6e6bcc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:50.516925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1ded0aa7-ed07-4aea-9d12-9f10b6e6bcc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:50.523396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1ded0aa7-ed07-4aea-9d12-9f10b6e6bcc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:50.523848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1ded0aa7-ed07-4aea-9d12-9f10b6e6bcc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:50.524606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1ded0aa7-ed07-4aea-9d12-9f10b6e6bcc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:50.525038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1ded0aa7-ed07-4aea-9d12-9f10b6e6bcc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:50.653111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1ded0aa7-ed07-4aea-9d12-9f10b6e6bcc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:50.660911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1ded0aa7-ed07-4aea-9d12-9f10b6e6bcc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.148450 May 26 13:23:50.661480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 843/1658] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:50 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:51.677969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14d2cc6e-2264-4ace-b76e-a46ca4091dc5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:51.678614 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14d2cc6e-2264-4ace-b76e-a46ca4091dc5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:51.685206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14d2cc6e-2264-4ace-b76e-a46ca4091dc5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:51.685660 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14d2cc6e-2264-4ace-b76e-a46ca4091dc5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:51.686430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14d2cc6e-2264-4ace-b76e-a46ca4091dc5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:51.686900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14d2cc6e-2264-4ace-b76e-a46ca4091dc5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:51.816403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14d2cc6e-2264-4ace-b76e-a46ca4091dc5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:51.824929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14d2cc6e-2264-4ace-b76e-a46ca4091dc5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150821 May 26 13:23:51.825501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 816/1659] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:51 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:52.841531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d79dc3a0-f27f-42b1-b939-570348a2ca59 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:52.842145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d79dc3a0-f27f-42b1-b939-570348a2ca59 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:52.844319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:23:52.849019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d79dc3a0-f27f-42b1-b939-570348a2ca59 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:52.849466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d79dc3a0-f27f-42b1-b939-570348a2ca59 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:52.850220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d79dc3a0-f27f-42b1-b939-570348a2ca59 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:52.850707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d79dc3a0-f27f-42b1-b939-570348a2ca59 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:52.853761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:23:52.980161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d79dc3a0-f27f-42b1-b939-570348a2ca59 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:52.989235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d79dc3a0-f27f-42b1-b939-570348a2ca59 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151547 May 26 13:23:52.989806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 844/1660] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:52 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:23:54.007414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d727d2b-5f86-4657-9282-3c3343b60198 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:54.008013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d727d2b-5f86-4657-9282-3c3343b60198 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:54.011517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:23:54.016267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d727d2b-5f86-4657-9282-3c3343b60198 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:54.016723 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d727d2b-5f86-4657-9282-3c3343b60198 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:54.017494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d727d2b-5f86-4657-9282-3c3343b60198 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:54.017939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d727d2b-5f86-4657-9282-3c3343b60198 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:54.020484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:23:54.148622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d727d2b-5f86-4657-9282-3c3343b60198 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:54.156659 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d727d2b-5f86-4657-9282-3c3343b60198 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153152 May 26 13:23:54.157212 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 817/1661] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:54 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:55.173021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97f05639-ae04-4763-b3c2-927b0f4279f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:55.173804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97f05639-ae04-4763-b3c2-927b0f4279f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:55.180701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97f05639-ae04-4763-b3c2-927b0f4279f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:55.181142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97f05639-ae04-4763-b3c2-927b0f4279f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:55.181912 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97f05639-ae04-4763-b3c2-927b0f4279f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:55.182353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97f05639-ae04-4763-b3c2-927b0f4279f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:55.313989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97f05639-ae04-4763-b3c2-927b0f4279f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:55.322497 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97f05639-ae04-4763-b3c2-927b0f4279f7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153333 May 26 13:23:55.323091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 845/1662] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:55 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:56.340120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f7fa395-f1c8-4b22-8fe3-664ebf6962cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:56.340730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f7fa395-f1c8-4b22-8fe3-664ebf6962cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:56.347302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f7fa395-f1c8-4b22-8fe3-664ebf6962cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:56.348537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f7fa395-f1c8-4b22-8fe3-664ebf6962cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:56.349316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f7fa395-f1c8-4b22-8fe3-664ebf6962cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:56.349749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f7fa395-f1c8-4b22-8fe3-664ebf6962cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:56.483612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2f7fa395-f1c8-4b22-8fe3-664ebf6962cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:56.491805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f7fa395-f1c8-4b22-8fe3-664ebf6962cd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156027 May 26 13:23:56.492403 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 818/1663] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:56 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:57.509660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-35ba7e05-33e3-4f80-9938-82beb0075cb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:57.510217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-35ba7e05-33e3-4f80-9938-82beb0075cb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:57.516689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35ba7e05-33e3-4f80-9938-82beb0075cb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:57.517144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35ba7e05-33e3-4f80-9938-82beb0075cb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:57.517913 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35ba7e05-33e3-4f80-9938-82beb0075cb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:57.518350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35ba7e05-33e3-4f80-9938-82beb0075cb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:57.647978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-35ba7e05-33e3-4f80-9938-82beb0075cb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:57.656917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-35ba7e05-33e3-4f80-9938-82beb0075cb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151856 May 26 13:23:57.657496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 846/1664] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:57 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:58.675386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8aa46b74-d7e1-4537-b889-891507d7ba63 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:58.676031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8aa46b74-d7e1-4537-b889-891507d7ba63 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:58.682584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8aa46b74-d7e1-4537-b889-891507d7ba63 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:58.683033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8aa46b74-d7e1-4537-b889-891507d7ba63 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:58.684016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8aa46b74-d7e1-4537-b889-891507d7ba63 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:58.684317 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8aa46b74-d7e1-4537-b889-891507d7ba63 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:58.810927 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8aa46b74-d7e1-4537-b889-891507d7ba63 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:58.818856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8aa46b74-d7e1-4537-b889-891507d7ba63 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.147422 May 26 13:23:58.819414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 819/1665] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:58 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:23:59.836354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4986b97f-e98f-473f-ad3c-182f18f53f37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:23:59.837022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4986b97f-e98f-473f-ad3c-182f18f53f37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:23:59.843722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4986b97f-e98f-473f-ad3c-182f18f53f37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:59.844169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4986b97f-e98f-473f-ad3c-182f18f53f37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:59.844943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4986b97f-e98f-473f-ad3c-182f18f53f37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:23:59.845381 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4986b97f-e98f-473f-ad3c-182f18f53f37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:23:59.976154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4986b97f-e98f-473f-ad3c-182f18f53f37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:23:59.984303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4986b97f-e98f-473f-ad3c-182f18f53f37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151845 May 26 13:23:59.984877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 847/1666] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:23:59 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:01.001386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e7ee639-223a-4176-a21a-5f32b1a5ccb5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:01.002040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e7ee639-223a-4176-a21a-5f32b1a5ccb5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:01.008661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e7ee639-223a-4176-a21a-5f32b1a5ccb5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:01.009124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e7ee639-223a-4176-a21a-5f32b1a5ccb5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:01.009909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e7ee639-223a-4176-a21a-5f32b1a5ccb5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:01.010354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e7ee639-223a-4176-a21a-5f32b1a5ccb5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:01.141567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e7ee639-223a-4176-a21a-5f32b1a5ccb5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:01.149558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e7ee639-223a-4176-a21a-5f32b1a5ccb5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152161 May 26 13:24:01.150125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 820/1667] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:00 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:02.167366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7782064-749d-4019-a02f-9c2c9507b623 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:02.167963 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7782064-749d-4019-a02f-9c2c9507b623 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:02.175769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7782064-749d-4019-a02f-9c2c9507b623 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:02.176162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7782064-749d-4019-a02f-9c2c9507b623 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:02.176940 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7782064-749d-4019-a02f-9c2c9507b623 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:02.177383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7782064-749d-4019-a02f-9c2c9507b623 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:02.307839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7782064-749d-4019-a02f-9c2c9507b623 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:02.315890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7782064-749d-4019-a02f-9c2c9507b623 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152458 May 26 13:24:02.316461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 848/1668] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:02 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:03.333429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b9bf184-46cf-4580-883a-a1ab603bce89 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:03.334137 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b9bf184-46cf-4580-883a-a1ab603bce89 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:03.341376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b9bf184-46cf-4580-883a-a1ab603bce89 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:03.341847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b9bf184-46cf-4580-883a-a1ab603bce89 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:03.342704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b9bf184-46cf-4580-883a-a1ab603bce89 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:03.343147 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b9bf184-46cf-4580-883a-a1ab603bce89 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:03.476214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b9bf184-46cf-4580-883a-a1ab603bce89 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:03.485010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b9bf184-46cf-4580-883a-a1ab603bce89 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155651 May 26 13:24:03.485590 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 821/1669] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:03 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:04.503199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce380465-94f8-4e6e-88b0-7b8585ff6c6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:04.503814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce380465-94f8-4e6e-88b0-7b8585ff6c6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:04.510301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce380465-94f8-4e6e-88b0-7b8585ff6c6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:04.510778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce380465-94f8-4e6e-88b0-7b8585ff6c6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:04.511536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce380465-94f8-4e6e-88b0-7b8585ff6c6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:04.511969 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce380465-94f8-4e6e-88b0-7b8585ff6c6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:04.639084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ce380465-94f8-4e6e-88b0-7b8585ff6c6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:04.646885 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce380465-94f8-4e6e-88b0-7b8585ff6c6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.147504 May 26 13:24:04.647453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 849/1670] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:04 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:05.664507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d80755f9-c7cd-4181-bd8c-689aa0bceb0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:05.665127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d80755f9-c7cd-4181-bd8c-689aa0bceb0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:05.672478 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d80755f9-c7cd-4181-bd8c-689aa0bceb0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:05.672943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d80755f9-c7cd-4181-bd8c-689aa0bceb0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:05.673720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d80755f9-c7cd-4181-bd8c-689aa0bceb0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:05.674164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d80755f9-c7cd-4181-bd8c-689aa0bceb0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:05.805175 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d80755f9-c7cd-4181-bd8c-689aa0bceb0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:05.814041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d80755f9-c7cd-4181-bd8c-689aa0bceb0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153423 May 26 13:24:05.814630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 822/1671] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:05 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:06.831417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fd60b0c-5001-4482-bc5a-52ef2b6d3404 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:06.832024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fd60b0c-5001-4482-bc5a-52ef2b6d3404 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:06.838489 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fd60b0c-5001-4482-bc5a-52ef2b6d3404 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:06.838968 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fd60b0c-5001-4482-bc5a-52ef2b6d3404 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:06.839728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fd60b0c-5001-4482-bc5a-52ef2b6d3404 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:06.840170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fd60b0c-5001-4482-bc5a-52ef2b6d3404 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:06.973544 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fd60b0c-5001-4482-bc5a-52ef2b6d3404 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:06.981893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fd60b0c-5001-4482-bc5a-52ef2b6d3404 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154380 May 26 13:24:06.982469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 850/1672] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:06 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:08.000098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-414752a1-21db-4b69-b463-da15f82bcc0e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:08.000717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-414752a1-21db-4b69-b463-da15f82bcc0e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:08.007385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-414752a1-21db-4b69-b463-da15f82bcc0e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:08.007847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-414752a1-21db-4b69-b463-da15f82bcc0e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:08.008628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-414752a1-21db-4b69-b463-da15f82bcc0e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:08.009076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-414752a1-21db-4b69-b463-da15f82bcc0e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:08.140710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-414752a1-21db-4b69-b463-da15f82bcc0e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:08.148556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-414752a1-21db-4b69-b463-da15f82bcc0e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153318 May 26 13:24:08.149126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 823/1673] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:07 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:09.166656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ad43e932-569b-460c-8c76-df90f464c61e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:09.167298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ad43e932-569b-460c-8c76-df90f464c61e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:09.175434 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad43e932-569b-460c-8c76-df90f464c61e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:09.175887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad43e932-569b-460c-8c76-df90f464c61e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:09.176700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad43e932-569b-460c-8c76-df90f464c61e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:09.177138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad43e932-569b-460c-8c76-df90f464c61e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:09.311554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ad43e932-569b-460c-8c76-df90f464c61e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:09.319374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ad43e932-569b-460c-8c76-df90f464c61e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156749 May 26 13:24:09.319950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 851/1674] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:09 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:10.336644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36bc9669-40b5-40af-88e5-ba4d168ff81a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:10.337252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36bc9669-40b5-40af-88e5-ba4d168ff81a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:10.344415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36bc9669-40b5-40af-88e5-ba4d168ff81a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:10.344860 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36bc9669-40b5-40af-88e5-ba4d168ff81a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:10.345625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36bc9669-40b5-40af-88e5-ba4d168ff81a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:10.346063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36bc9669-40b5-40af-88e5-ba4d168ff81a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:10.484315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36bc9669-40b5-40af-88e5-ba4d168ff81a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:10.492386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36bc9669-40b5-40af-88e5-ba4d168ff81a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.159615 May 26 13:24:10.494438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 824/1675] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:10 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:11.510627 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42c13d81-0ff0-40d8-9785-fbd4872ff53b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:11.511223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42c13d81-0ff0-40d8-9785-fbd4872ff53b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:11.518561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42c13d81-0ff0-40d8-9785-fbd4872ff53b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:11.519025 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42c13d81-0ff0-40d8-9785-fbd4872ff53b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:11.519825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42c13d81-0ff0-40d8-9785-fbd4872ff53b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:11.520268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42c13d81-0ff0-40d8-9785-fbd4872ff53b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:11.668683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42c13d81-0ff0-40d8-9785-fbd4872ff53b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:11.677757 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42c13d81-0ff0-40d8-9785-fbd4872ff53b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.170938 May 26 13:24:11.678343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 852/1676] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:11 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:12.695724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-994e923f-5844-4896-a09c-28f4fcfbf9ec tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:12.696342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-994e923f-5844-4896-a09c-28f4fcfbf9ec tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:12.703765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-994e923f-5844-4896-a09c-28f4fcfbf9ec tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:12.704215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-994e923f-5844-4896-a09c-28f4fcfbf9ec tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:12.704993 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-994e923f-5844-4896-a09c-28f4fcfbf9ec tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:12.705434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-994e923f-5844-4896-a09c-28f4fcfbf9ec tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:12.849364 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-994e923f-5844-4896-a09c-28f4fcfbf9ec tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:12.858354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-994e923f-5844-4896-a09c-28f4fcfbf9ec tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.166508 May 26 13:24:12.859168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 825/1677] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:12 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:13.875570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68156984-8205-4ebc-a511-da59ff1e730d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:13.876170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68156984-8205-4ebc-a511-da59ff1e730d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:13.882765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68156984-8205-4ebc-a511-da59ff1e730d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:13.884500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68156984-8205-4ebc-a511-da59ff1e730d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:13.884500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68156984-8205-4ebc-a511-da59ff1e730d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:13.884500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68156984-8205-4ebc-a511-da59ff1e730d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:14.012546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68156984-8205-4ebc-a511-da59ff1e730d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:14.021235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68156984-8205-4ebc-a511-da59ff1e730d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149718 May 26 13:24:14.021800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 853/1678] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:13 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:15.039473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a3a6f49-634c-456f-9f96-709c6fcf511e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:15.040035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a3a6f49-634c-456f-9f96-709c6fcf511e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:15.046599 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a3a6f49-634c-456f-9f96-709c6fcf511e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:15.047050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a3a6f49-634c-456f-9f96-709c6fcf511e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:15.047810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a3a6f49-634c-456f-9f96-709c6fcf511e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:15.048243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a3a6f49-634c-456f-9f96-709c6fcf511e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:15.184834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a3a6f49-634c-456f-9f96-709c6fcf511e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:15.193486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a3a6f49-634c-456f-9f96-709c6fcf511e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157958 May 26 13:24:15.194062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 826/1679] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:15 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:16.210982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fed368eb-b133-4620-8924-5cf393f467cc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:16.211601 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fed368eb-b133-4620-8924-5cf393f467cc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:16.218586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed368eb-b133-4620-8924-5cf393f467cc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:16.219044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed368eb-b133-4620-8924-5cf393f467cc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:16.219816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed368eb-b133-4620-8924-5cf393f467cc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:16.220258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed368eb-b133-4620-8924-5cf393f467cc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:16.354277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fed368eb-b133-4620-8924-5cf393f467cc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:16.362980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fed368eb-b133-4620-8924-5cf393f467cc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155746 May 26 13:24:16.363551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 854/1680] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:16 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:17.380189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd5a4ce4-2767-4438-823d-d4eb63a2a71d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:17.380832 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd5a4ce4-2767-4438-823d-d4eb63a2a71d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:17.387482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd5a4ce4-2767-4438-823d-d4eb63a2a71d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:17.387936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd5a4ce4-2767-4438-823d-d4eb63a2a71d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:17.389624 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd5a4ce4-2767-4438-823d-d4eb63a2a71d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:17.390065 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd5a4ce4-2767-4438-823d-d4eb63a2a71d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:17.517915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd5a4ce4-2767-4438-823d-d4eb63a2a71d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:17.525783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd5a4ce4-2767-4438-823d-d4eb63a2a71d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.149529 May 26 13:24:17.526340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 827/1681] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:17 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:18.542949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7908b4c3-6be8-423a-9776-0c6f9dddf40a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:18.543535 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7908b4c3-6be8-423a-9776-0c6f9dddf40a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:18.550881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7908b4c3-6be8-423a-9776-0c6f9dddf40a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:18.551336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7908b4c3-6be8-423a-9776-0c6f9dddf40a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:18.552105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7908b4c3-6be8-423a-9776-0c6f9dddf40a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:18.552546 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7908b4c3-6be8-423a-9776-0c6f9dddf40a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:18.681404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7908b4c3-6be8-423a-9776-0c6f9dddf40a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:18.689402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7908b4c3-6be8-423a-9776-0c6f9dddf40a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150472 May 26 13:24:18.690178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 855/1682] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:18 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:19.707568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f551bb18-f4d1-4b1c-8283-53a4354f3ed3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:19.708218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f551bb18-f4d1-4b1c-8283-53a4354f3ed3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:19.714511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f551bb18-f4d1-4b1c-8283-53a4354f3ed3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:19.714996 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f551bb18-f4d1-4b1c-8283-53a4354f3ed3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:19.715763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f551bb18-f4d1-4b1c-8283-53a4354f3ed3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:19.716301 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f551bb18-f4d1-4b1c-8283-53a4354f3ed3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:19.853204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f551bb18-f4d1-4b1c-8283-53a4354f3ed3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:19.861282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f551bb18-f4d1-4b1c-8283-53a4354f3ed3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157835 May 26 13:24:19.861836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 828/1683] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:19 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:20.961542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee7d6a2b-78c0-462f-a1dd-8b6eb8c2a7a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:20.962161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee7d6a2b-78c0-462f-a1dd-8b6eb8c2a7a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:20.968933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee7d6a2b-78c0-462f-a1dd-8b6eb8c2a7a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:20.969394 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee7d6a2b-78c0-462f-a1dd-8b6eb8c2a7a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:20.970169 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee7d6a2b-78c0-462f-a1dd-8b6eb8c2a7a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:20.970638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee7d6a2b-78c0-462f-a1dd-8b6eb8c2a7a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:21.098851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee7d6a2b-78c0-462f-a1dd-8b6eb8c2a7a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:21.106985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee7d6a2b-78c0-462f-a1dd-8b6eb8c2a7a1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.232503 May 26 13:24:21.107492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 856/1684] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:20 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:22.126013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-024e1bf2-aee5-4e7c-bc7b-019043a75a67 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:22.126797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-024e1bf2-aee5-4e7c-bc7b-019043a75a67 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:22.133283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-024e1bf2-aee5-4e7c-bc7b-019043a75a67 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:22.133732 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-024e1bf2-aee5-4e7c-bc7b-019043a75a67 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:22.134490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-024e1bf2-aee5-4e7c-bc7b-019043a75a67 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:22.134955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-024e1bf2-aee5-4e7c-bc7b-019043a75a67 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:22.262511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-024e1bf2-aee5-4e7c-bc7b-019043a75a67 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:22.272368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-024e1bf2-aee5-4e7c-bc7b-019043a75a67 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150742 May 26 13:24:22.272952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 829/1685] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:22 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:23.289792 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be470231-4855-453d-a705-0a4a844dd235 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:23.290401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be470231-4855-453d-a705-0a4a844dd235 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:23.292444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:23.297187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be470231-4855-453d-a705-0a4a844dd235 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:23.297843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be470231-4855-453d-a705-0a4a844dd235 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:23.298637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be470231-4855-453d-a705-0a4a844dd235 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:23.299072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be470231-4855-453d-a705-0a4a844dd235 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:23.301595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:23.435495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be470231-4855-453d-a705-0a4a844dd235 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:23.444774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be470231-4855-453d-a705-0a4a844dd235 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158880 May 26 13:24:23.445351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 857/1686] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:23 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:24.462744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c99fbf1-abe4-4c3a-b38d-9bea15f25781 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:24.463397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c99fbf1-abe4-4c3a-b38d-9bea15f25781 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:24.465781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:24.471717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c99fbf1-abe4-4c3a-b38d-9bea15f25781 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:24.472204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c99fbf1-abe4-4c3a-b38d-9bea15f25781 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:24.472983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c99fbf1-abe4-4c3a-b38d-9bea15f25781 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:24.473418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c99fbf1-abe4-4c3a-b38d-9bea15f25781 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:24.477380 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:24.614260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c99fbf1-abe4-4c3a-b38d-9bea15f25781 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:24.622140 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c99fbf1-abe4-4c3a-b38d-9bea15f25781 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.163404 May 26 13:24:24.622723 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 830/1687] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:24 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:25.639583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc8818c2-0fbd-484f-801f-ff5aa3c2b3c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:25.640190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc8818c2-0fbd-484f-801f-ff5aa3c2b3c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:25.646728 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc8818c2-0fbd-484f-801f-ff5aa3c2b3c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:25.647175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc8818c2-0fbd-484f-801f-ff5aa3c2b3c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:25.647930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc8818c2-0fbd-484f-801f-ff5aa3c2b3c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:25.648382 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc8818c2-0fbd-484f-801f-ff5aa3c2b3c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:25.777467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc8818c2-0fbd-484f-801f-ff5aa3c2b3c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:25.786268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc8818c2-0fbd-484f-801f-ff5aa3c2b3c0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150474 May 26 13:24:25.786877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 858/1688] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:25 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:25.819877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:24:25.820085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:24:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:24:26.803893 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8b2dc3aa-2b3f-42d6-8c4c-c7d72ea5be29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:26.804535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8b2dc3aa-2b3f-42d6-8c4c-c7d72ea5be29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:26.811320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b2dc3aa-2b3f-42d6-8c4c-c7d72ea5be29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:26.811774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b2dc3aa-2b3f-42d6-8c4c-c7d72ea5be29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:26.812558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b2dc3aa-2b3f-42d6-8c4c-c7d72ea5be29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:26.813488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b2dc3aa-2b3f-42d6-8c4c-c7d72ea5be29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:26.953313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8b2dc3aa-2b3f-42d6-8c4c-c7d72ea5be29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:26.961899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8b2dc3aa-2b3f-42d6-8c4c-c7d72ea5be29 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.162074 May 26 13:24:26.962456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 831/1689] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:26 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:27.980138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-167881e3-0eeb-40f7-9ee4-33720469d7f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:27.980748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-167881e3-0eeb-40f7-9ee4-33720469d7f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:27.987506 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-167881e3-0eeb-40f7-9ee4-33720469d7f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:27.987956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-167881e3-0eeb-40f7-9ee4-33720469d7f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:27.988713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-167881e3-0eeb-40f7-9ee4-33720469d7f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:27.989430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-167881e3-0eeb-40f7-9ee4-33720469d7f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:28.121975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-167881e3-0eeb-40f7-9ee4-33720469d7f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:28.129935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-167881e3-0eeb-40f7-9ee4-33720469d7f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153945 May 26 13:24:28.130498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 859/1690] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:27 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:29.146108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fdfa536c-ab6d-460c-a356-43f6b8cb7b86 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:29.146729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fdfa536c-ab6d-460c-a356-43f6b8cb7b86 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:29.153647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdfa536c-ab6d-460c-a356-43f6b8cb7b86 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:29.154041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdfa536c-ab6d-460c-a356-43f6b8cb7b86 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:29.154835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdfa536c-ab6d-460c-a356-43f6b8cb7b86 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:29.155269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdfa536c-ab6d-460c-a356-43f6b8cb7b86 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:29.288572 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fdfa536c-ab6d-460c-a356-43f6b8cb7b86 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:29.296605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fdfa536c-ab6d-460c-a356-43f6b8cb7b86 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154329 May 26 13:24:29.297243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 832/1691] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:29 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:24:30.315551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f7c876f-8c3b-4ea8-b403-b1969e5c2462 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:30.316233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f7c876f-8c3b-4ea8-b403-b1969e5c2462 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:30.322937 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7c876f-8c3b-4ea8-b403-b1969e5c2462 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:30.323390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7c876f-8c3b-4ea8-b403-b1969e5c2462 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:30.324164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7c876f-8c3b-4ea8-b403-b1969e5c2462 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:30.324606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7c876f-8c3b-4ea8-b403-b1969e5c2462 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:30.456915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f7c876f-8c3b-4ea8-b403-b1969e5c2462 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:30.464963 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f7c876f-8c3b-4ea8-b403-b1969e5c2462 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154181 May 26 13:24:30.465536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 860/1692] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:30 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:31.482514 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8304f434-318a-43ae-aa56-3ed5c77a9d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:31.483149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8304f434-318a-43ae-aa56-3ed5c77a9d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:31.490603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8304f434-318a-43ae-aa56-3ed5c77a9d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:31.491058 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8304f434-318a-43ae-aa56-3ed5c77a9d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:31.491856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8304f434-318a-43ae-aa56-3ed5c77a9d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:31.492290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8304f434-318a-43ae-aa56-3ed5c77a9d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:31.629982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8304f434-318a-43ae-aa56-3ed5c77a9d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:31.638294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8304f434-318a-43ae-aa56-3ed5c77a9d58 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.159596 May 26 13:24:31.638919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 833/1693] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:31 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:32.657485 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44514442-0cbc-44a2-9b95-90cb3391fdbd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:32.659265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-44514442-0cbc-44a2-9b95-90cb3391fdbd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:32.664818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44514442-0cbc-44a2-9b95-90cb3391fdbd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:32.665264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44514442-0cbc-44a2-9b95-90cb3391fdbd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:32.666030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44514442-0cbc-44a2-9b95-90cb3391fdbd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:32.666466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44514442-0cbc-44a2-9b95-90cb3391fdbd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:32.800372 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-44514442-0cbc-44a2-9b95-90cb3391fdbd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:32.808588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44514442-0cbc-44a2-9b95-90cb3391fdbd tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156460 May 26 13:24:32.809180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 861/1694] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:32 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:24:33.827126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d9f3d7e7-5481-40e2-adb7-b5cc2ab1c83a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:33.827761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d9f3d7e7-5481-40e2-adb7-b5cc2ab1c83a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:33.834278 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9f3d7e7-5481-40e2-adb7-b5cc2ab1c83a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:33.834767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9f3d7e7-5481-40e2-adb7-b5cc2ab1c83a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:33.835538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9f3d7e7-5481-40e2-adb7-b5cc2ab1c83a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:33.835972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9f3d7e7-5481-40e2-adb7-b5cc2ab1c83a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:33.967674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9f3d7e7-5481-40e2-adb7-b5cc2ab1c83a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:33.976628 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d9f3d7e7-5481-40e2-adb7-b5cc2ab1c83a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153866 May 26 13:24:33.977458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 834/1695] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:33 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:34.993518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5796a09d-2b24-45e7-a916-fabc913aab0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:34.994098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5796a09d-2b24-45e7-a916-fabc913aab0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:35.000603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5796a09d-2b24-45e7-a916-fabc913aab0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:35.001056 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5796a09d-2b24-45e7-a916-fabc913aab0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:35.002023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5796a09d-2b24-45e7-a916-fabc913aab0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:35.002647 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5796a09d-2b24-45e7-a916-fabc913aab0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:35.153511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5796a09d-2b24-45e7-a916-fabc913aab0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:35.162769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5796a09d-2b24-45e7-a916-fabc913aab0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.173058 May 26 13:24:35.163361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 862/1696] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:34 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:36.180492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b5d2c47-82f1-4db9-ad1f-4eaa346a46e1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:36.181104 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b5d2c47-82f1-4db9-ad1f-4eaa346a46e1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:36.187660 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b5d2c47-82f1-4db9-ad1f-4eaa346a46e1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:36.188111 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b5d2c47-82f1-4db9-ad1f-4eaa346a46e1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:36.189590 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b5d2c47-82f1-4db9-ad1f-4eaa346a46e1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:36.190080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b5d2c47-82f1-4db9-ad1f-4eaa346a46e1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:36.325369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b5d2c47-82f1-4db9-ad1f-4eaa346a46e1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:36.334010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b5d2c47-82f1-4db9-ad1f-4eaa346a46e1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157366 May 26 13:24:36.334612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 835/1697] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:36 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:37.351459 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56e7bb25-2570-473f-90d2-b28120f28a25 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:37.352321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56e7bb25-2570-473f-90d2-b28120f28a25 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:37.358877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56e7bb25-2570-473f-90d2-b28120f28a25 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:37.359332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56e7bb25-2570-473f-90d2-b28120f28a25 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:37.360094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56e7bb25-2570-473f-90d2-b28120f28a25 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:37.360536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56e7bb25-2570-473f-90d2-b28120f28a25 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:37.489764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56e7bb25-2570-473f-90d2-b28120f28a25 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:37.497963 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56e7bb25-2570-473f-90d2-b28120f28a25 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.150406 May 26 13:24:37.498547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 863/1698] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:37 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:38.516316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e3f48465-a00e-4c01-8086-522ae51449d7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:38.516890 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e3f48465-a00e-4c01-8086-522ae51449d7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:38.523632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3f48465-a00e-4c01-8086-522ae51449d7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:38.524098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3f48465-a00e-4c01-8086-522ae51449d7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:38.524877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3f48465-a00e-4c01-8086-522ae51449d7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:38.525336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3f48465-a00e-4c01-8086-522ae51449d7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:38.664995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e3f48465-a00e-4c01-8086-522ae51449d7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:38.672978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e3f48465-a00e-4c01-8086-522ae51449d7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.160642 May 26 13:24:38.674565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 836/1699] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:38 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:39.691604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31b076b0-a8b2-4d2c-b7b4-59ff413ce292 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:39.692208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31b076b0-a8b2-4d2c-b7b4-59ff413ce292 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:39.699008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b076b0-a8b2-4d2c-b7b4-59ff413ce292 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:39.699466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b076b0-a8b2-4d2c-b7b4-59ff413ce292 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:39.700236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b076b0-a8b2-4d2c-b7b4-59ff413ce292 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:39.700683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b076b0-a8b2-4d2c-b7b4-59ff413ce292 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:39.837844 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-31b076b0-a8b2-4d2c-b7b4-59ff413ce292 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:39.846220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31b076b0-a8b2-4d2c-b7b4-59ff413ce292 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158247 May 26 13:24:39.846825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 864/1700] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:39 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:40.872013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da33834b-ebac-41c9-add0-8c3f25019fb3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:40.872629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da33834b-ebac-41c9-add0-8c3f25019fb3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:40.879353 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da33834b-ebac-41c9-add0-8c3f25019fb3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:40.879811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da33834b-ebac-41c9-add0-8c3f25019fb3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:40.880594 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da33834b-ebac-41c9-add0-8c3f25019fb3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:40.881036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da33834b-ebac-41c9-add0-8c3f25019fb3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:41.018912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da33834b-ebac-41c9-add0-8c3f25019fb3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:41.028117 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da33834b-ebac-41c9-add0-8c3f25019fb3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.159788 May 26 13:24:41.028999 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 837/1701] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:40 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:42.048269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-29d605d2-ed08-44f6-90a7-f92d196eb7d5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:42.049461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-29d605d2-ed08-44f6-90a7-f92d196eb7d5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:42.056743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29d605d2-ed08-44f6-90a7-f92d196eb7d5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:42.057204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29d605d2-ed08-44f6-90a7-f92d196eb7d5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:42.057991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29d605d2-ed08-44f6-90a7-f92d196eb7d5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:42.058438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29d605d2-ed08-44f6-90a7-f92d196eb7d5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:42.189021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-29d605d2-ed08-44f6-90a7-f92d196eb7d5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:42.197122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-29d605d2-ed08-44f6-90a7-f92d196eb7d5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152951 May 26 13:24:42.197717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 865/1702] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:42 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:43.214674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7eae5875-98b0-4b61-a5cd-b9fe67ff83c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:43.215721 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7eae5875-98b0-4b61-a5cd-b9fe67ff83c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:43.223088 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7eae5875-98b0-4b61-a5cd-b9fe67ff83c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:43.223541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7eae5875-98b0-4b61-a5cd-b9fe67ff83c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:43.224503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7eae5875-98b0-4b61-a5cd-b9fe67ff83c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:43.224975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7eae5875-98b0-4b61-a5cd-b9fe67ff83c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:43.354795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7eae5875-98b0-4b61-a5cd-b9fe67ff83c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:43.364341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7eae5875-98b0-4b61-a5cd-b9fe67ff83c4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153462 May 26 13:24:43.365424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 838/1703] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:43 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:43.436919 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:24:43.437479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:24:44.382661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-54d895e7-2656-40f2-8e91-dd1941fa7e00 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:44.383431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-54d895e7-2656-40f2-8e91-dd1941fa7e00 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:44.389975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54d895e7-2656-40f2-8e91-dd1941fa7e00 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:44.390425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54d895e7-2656-40f2-8e91-dd1941fa7e00 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:44.391228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54d895e7-2656-40f2-8e91-dd1941fa7e00 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:44.391669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54d895e7-2656-40f2-8e91-dd1941fa7e00 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:44.534566 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54d895e7-2656-40f2-8e91-dd1941fa7e00 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:44.540794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-54d895e7-2656-40f2-8e91-dd1941fa7e00 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.162207 May 26 13:24:44.541362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 866/1704] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:44 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:45.557102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e74df250-7e91-4083-ae48-107dfe0445be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:45.557715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e74df250-7e91-4083-ae48-107dfe0445be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:45.564283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e74df250-7e91-4083-ae48-107dfe0445be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:45.564733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e74df250-7e91-4083-ae48-107dfe0445be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:45.565496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e74df250-7e91-4083-ae48-107dfe0445be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:45.565932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e74df250-7e91-4083-ae48-107dfe0445be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:45.716143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e74df250-7e91-4083-ae48-107dfe0445be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:45.728990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e74df250-7e91-4083-ae48-107dfe0445be tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.175661 May 26 13:24:45.729591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 839/1705] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:45 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:46.747116 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aa1749b5-836f-4d29-8f05-7e9f8c02a624 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:46.747751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aa1749b5-836f-4d29-8f05-7e9f8c02a624 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:46.755384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa1749b5-836f-4d29-8f05-7e9f8c02a624 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:46.755829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa1749b5-836f-4d29-8f05-7e9f8c02a624 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:46.756594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa1749b5-836f-4d29-8f05-7e9f8c02a624 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:46.757028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa1749b5-836f-4d29-8f05-7e9f8c02a624 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:46.898300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa1749b5-836f-4d29-8f05-7e9f8c02a624 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:46.906280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aa1749b5-836f-4d29-8f05-7e9f8c02a624 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.163062 May 26 13:24:46.906870 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 867/1706] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:46 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:47.924456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f94cef90-a400-401d-a15f-de6a219ca514 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:47.925412 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f94cef90-a400-401d-a15f-de6a219ca514 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:47.932112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f94cef90-a400-401d-a15f-de6a219ca514 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:47.932563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f94cef90-a400-401d-a15f-de6a219ca514 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:47.933349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f94cef90-a400-401d-a15f-de6a219ca514 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:47.933795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f94cef90-a400-401d-a15f-de6a219ca514 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:48.069910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f94cef90-a400-401d-a15f-de6a219ca514 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:48.078666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f94cef90-a400-401d-a15f-de6a219ca514 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158831 May 26 13:24:48.079259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 840/1707] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:47 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:49.096661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77e4fbad-2b44-4ac8-bd43-3caaf8010792 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:49.097304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77e4fbad-2b44-4ac8-bd43-3caaf8010792 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:49.104151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77e4fbad-2b44-4ac8-bd43-3caaf8010792 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:49.104628 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77e4fbad-2b44-4ac8-bd43-3caaf8010792 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:49.105398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77e4fbad-2b44-4ac8-bd43-3caaf8010792 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:49.105831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77e4fbad-2b44-4ac8-bd43-3caaf8010792 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:49.240034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77e4fbad-2b44-4ac8-bd43-3caaf8010792 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:49.248068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77e4fbad-2b44-4ac8-bd43-3caaf8010792 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155313 May 26 13:24:49.248625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 868/1708] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:49 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:50.266649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-00914af2-9cd5-4aab-8150-5f8ff5cb2c13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:50.267937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-00914af2-9cd5-4aab-8150-5f8ff5cb2c13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:50.274874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00914af2-9cd5-4aab-8150-5f8ff5cb2c13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:50.275342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00914af2-9cd5-4aab-8150-5f8ff5cb2c13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:50.276131 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00914af2-9cd5-4aab-8150-5f8ff5cb2c13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:50.276575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00914af2-9cd5-4aab-8150-5f8ff5cb2c13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:50.417361 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-00914af2-9cd5-4aab-8150-5f8ff5cb2c13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:50.425688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-00914af2-9cd5-4aab-8150-5f8ff5cb2c13 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.163614 May 26 13:24:50.426576 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 841/1709] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:50 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:51.445570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5009ebf8-f053-4421-b071-57bf8600d8b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:51.446206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5009ebf8-f053-4421-b071-57bf8600d8b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:51.454049 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5009ebf8-f053-4421-b071-57bf8600d8b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:51.454652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5009ebf8-f053-4421-b071-57bf8600d8b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:51.455430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5009ebf8-f053-4421-b071-57bf8600d8b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:51.455861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5009ebf8-f053-4421-b071-57bf8600d8b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:51.608045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5009ebf8-f053-4421-b071-57bf8600d8b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:51.617042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5009ebf8-f053-4421-b071-57bf8600d8b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.175825 May 26 13:24:51.646188 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 869/1710] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:51 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:52.635080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ff36e5e-fee2-4572-a828-5e98295faaa5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:52.635689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ff36e5e-fee2-4572-a828-5e98295faaa5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:52.643133 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ff36e5e-fee2-4572-a828-5e98295faaa5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:52.643580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ff36e5e-fee2-4572-a828-5e98295faaa5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:52.644360 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ff36e5e-fee2-4572-a828-5e98295faaa5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:52.644795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ff36e5e-fee2-4572-a828-5e98295faaa5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:52.780578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ff36e5e-fee2-4572-a828-5e98295faaa5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:52.789408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ff36e5e-fee2-4572-a828-5e98295faaa5 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158448 May 26 13:24:52.790020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 842/1711] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:52 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:53.807096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17698f00-8a23-45fc-8f35-0a9bb3c58c14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:53.807698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17698f00-8a23-45fc-8f35-0a9bb3c58c14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:53.809538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:53.816052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17698f00-8a23-45fc-8f35-0a9bb3c58c14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:53.823034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17698f00-8a23-45fc-8f35-0a9bb3c58c14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:53.823034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17698f00-8a23-45fc-8f35-0a9bb3c58c14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:53.823034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17698f00-8a23-45fc-8f35-0a9bb3c58c14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:53.824322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:53.956810 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-17698f00-8a23-45fc-8f35-0a9bb3c58c14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:53.964741 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17698f00-8a23-45fc-8f35-0a9bb3c58c14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.161656 May 26 13:24:53.965297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 870/1712] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:53 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:54.982033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eff0a988-7ed6-4385-a0c5-ec244992f874 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:54.982666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eff0a988-7ed6-4385-a0c5-ec244992f874 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:54.984941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:54.990322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eff0a988-7ed6-4385-a0c5-ec244992f874 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:54.990808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eff0a988-7ed6-4385-a0c5-ec244992f874 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:54.997523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eff0a988-7ed6-4385-a0c5-ec244992f874 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:54.997523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eff0a988-7ed6-4385-a0c5-ec244992f874 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:54.997523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:55.151107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eff0a988-7ed6-4385-a0c5-ec244992f874 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:55.160889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eff0a988-7ed6-4385-a0c5-ec244992f874 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.182638 May 26 13:24:55.161469 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 843/1713] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:54 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:56.178548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9b732696-79be-4ebc-bbb8-53ee5386fd0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:56.179168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9b732696-79be-4ebc-bbb8-53ee5386fd0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:56.185653 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b732696-79be-4ebc-bbb8-53ee5386fd0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:56.186101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b732696-79be-4ebc-bbb8-53ee5386fd0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:56.186894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b732696-79be-4ebc-bbb8-53ee5386fd0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:56.187351 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b732696-79be-4ebc-bbb8-53ee5386fd0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:56.323522 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9b732696-79be-4ebc-bbb8-53ee5386fd0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:56.332444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9b732696-79be-4ebc-bbb8-53ee5386fd0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157950 May 26 13:24:56.333028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 871/1714] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:56 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:24:57.350914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dad45e17-b032-43a0-98f5-2d9137d6ec42 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:57.351597 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dad45e17-b032-43a0-98f5-2d9137d6ec42 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:57.358490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad45e17-b032-43a0-98f5-2d9137d6ec42 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:57.359004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad45e17-b032-43a0-98f5-2d9137d6ec42 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:57.359770 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad45e17-b032-43a0-98f5-2d9137d6ec42 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:57.360207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dad45e17-b032-43a0-98f5-2d9137d6ec42 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:57.498347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dad45e17-b032-43a0-98f5-2d9137d6ec42 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:57.507505 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dad45e17-b032-43a0-98f5-2d9137d6ec42 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.160986 May 26 13:24:57.508085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 844/1715] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:57 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:58.525846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7bdc0462-324a-45fe-9cb1-85710cd07128 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:58.526423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7bdc0462-324a-45fe-9cb1-85710cd07128 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:58.534830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bdc0462-324a-45fe-9cb1-85710cd07128 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:58.542312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bdc0462-324a-45fe-9cb1-85710cd07128 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:58.542312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bdc0462-324a-45fe-9cb1-85710cd07128 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:58.542312 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bdc0462-324a-45fe-9cb1-85710cd07128 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:58.674129 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7bdc0462-324a-45fe-9cb1-85710cd07128 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:58.682648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7bdc0462-324a-45fe-9cb1-85710cd07128 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.160679 May 26 13:24:58.683226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 872/1716] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:58 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:24:59.700873 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d14d959c-8a79-4098-bdff-5e7566763a43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:24:59.701470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d14d959c-8a79-4098-bdff-5e7566763a43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:24:59.708824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d14d959c-8a79-4098-bdff-5e7566763a43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:59.709303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d14d959c-8a79-4098-bdff-5e7566763a43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:59.710080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d14d959c-8a79-4098-bdff-5e7566763a43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:24:59.710564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d14d959c-8a79-4098-bdff-5e7566763a43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:24:59.877318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d14d959c-8a79-4098-bdff-5e7566763a43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:24:59.885464 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d14d959c-8a79-4098-bdff-5e7566763a43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.188494 May 26 13:24:59.886029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 845/1717] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:24:59 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:00.905847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f8d3482-7616-4579-897e-159f3546388d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:00.906493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f8d3482-7616-4579-897e-159f3546388d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:00.913223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f8d3482-7616-4579-897e-159f3546388d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:00.913669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f8d3482-7616-4579-897e-159f3546388d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:00.914430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f8d3482-7616-4579-897e-159f3546388d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:00.914893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f8d3482-7616-4579-897e-159f3546388d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:01.045367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4f8d3482-7616-4579-897e-159f3546388d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:01.054076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f8d3482-7616-4579-897e-159f3546388d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.152184 May 26 13:25:01.054667 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 873/1718] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:00 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:02.071550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ebc38941-355b-43f9-a6bc-4717faea6ef8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:02.072158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ebc38941-355b-43f9-a6bc-4717faea6ef8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:02.079170 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebc38941-355b-43f9-a6bc-4717faea6ef8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:02.080261 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebc38941-355b-43f9-a6bc-4717faea6ef8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:02.081046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebc38941-355b-43f9-a6bc-4717faea6ef8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:02.081481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebc38941-355b-43f9-a6bc-4717faea6ef8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:02.223811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebc38941-355b-43f9-a6bc-4717faea6ef8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:02.232184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ebc38941-355b-43f9-a6bc-4717faea6ef8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.164454 May 26 13:25:02.232755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 846/1719] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:02 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:03.251764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01de1ad5-94b4-4af8-a666-87819e716e3c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:03.252386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01de1ad5-94b4-4af8-a666-87819e716e3c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:03.259205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01de1ad5-94b4-4af8-a666-87819e716e3c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:03.259656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01de1ad5-94b4-4af8-a666-87819e716e3c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:03.260428 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01de1ad5-94b4-4af8-a666-87819e716e3c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:03.260864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01de1ad5-94b4-4af8-a666-87819e716e3c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:03.409251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01de1ad5-94b4-4af8-a666-87819e716e3c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:03.422174 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01de1ad5-94b4-4af8-a666-87819e716e3c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.174446 May 26 13:25:03.423619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 874/1720] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:03 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:04.441099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d53c1a27-2f21-4e56-9236-2db8643849e3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:04.441708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d53c1a27-2f21-4e56-9236-2db8643849e3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:04.448542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d53c1a27-2f21-4e56-9236-2db8643849e3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:04.448994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d53c1a27-2f21-4e56-9236-2db8643849e3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:04.449774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d53c1a27-2f21-4e56-9236-2db8643849e3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:04.450268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d53c1a27-2f21-4e56-9236-2db8643849e3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:04.596295 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d53c1a27-2f21-4e56-9236-2db8643849e3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:04.605129 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d53c1a27-2f21-4e56-9236-2db8643849e3 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.168865 May 26 13:25:04.605696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 847/1721] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:04 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:05.623360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c18add08-90ab-45bd-a158-6c5ab5f739f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:05.623360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c18add08-90ab-45bd-a158-6c5ab5f739f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:05.633668 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c18add08-90ab-45bd-a158-6c5ab5f739f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:05.634413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c18add08-90ab-45bd-a158-6c5ab5f739f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:05.635484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c18add08-90ab-45bd-a158-6c5ab5f739f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:05.636010 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c18add08-90ab-45bd-a158-6c5ab5f739f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:05.775392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c18add08-90ab-45bd-a158-6c5ab5f739f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:05.784590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c18add08-90ab-45bd-a158-6c5ab5f739f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.165027 May 26 13:25:05.785172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 875/1722] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:05 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:06.801957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aaaaa3df-f9d3-43b5-a436-83a3fe3c55e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:06.802633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aaaaa3df-f9d3-43b5-a436-83a3fe3c55e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:06.809100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaaaa3df-f9d3-43b5-a436-83a3fe3c55e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:06.809554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaaaa3df-f9d3-43b5-a436-83a3fe3c55e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:06.810305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaaaa3df-f9d3-43b5-a436-83a3fe3c55e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:06.810766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaaaa3df-f9d3-43b5-a436-83a3fe3c55e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:06.943167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aaaaa3df-f9d3-43b5-a436-83a3fe3c55e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:06.951128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aaaaa3df-f9d3-43b5-a436-83a3fe3c55e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.153688 May 26 13:25:06.951693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 848/1723] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:06 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:07.969396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ad7d46ae-98c9-4f1c-8881-57b1db6dfb8c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:07.970072 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ad7d46ae-98c9-4f1c-8881-57b1db6dfb8c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:07.977646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad7d46ae-98c9-4f1c-8881-57b1db6dfb8c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:07.977646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad7d46ae-98c9-4f1c-8881-57b1db6dfb8c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:07.978404 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad7d46ae-98c9-4f1c-8881-57b1db6dfb8c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:07.978894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad7d46ae-98c9-4f1c-8881-57b1db6dfb8c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:08.115714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ad7d46ae-98c9-4f1c-8881-57b1db6dfb8c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:08.123807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ad7d46ae-98c9-4f1c-8881-57b1db6dfb8c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.158372 May 26 13:25:08.124384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 876/1724] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:07 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:09.142368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca4a710e-2b71-417d-a6a7-05d3b479d702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:09.143168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ca4a710e-2b71-417d-a6a7-05d3b479d702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:09.149539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca4a710e-2b71-417d-a6a7-05d3b479d702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:09.149989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca4a710e-2b71-417d-a6a7-05d3b479d702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:09.150829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca4a710e-2b71-417d-a6a7-05d3b479d702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:09.151262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca4a710e-2b71-417d-a6a7-05d3b479d702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:09.289654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ca4a710e-2b71-417d-a6a7-05d3b479d702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:09.298085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ca4a710e-2b71-417d-a6a7-05d3b479d702 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.160169 May 26 13:25:09.303352 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 849/1725] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:09 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:10.319564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e49b2b5-c47d-498b-8fab-43c0fb680403 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:10.320200 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e49b2b5-c47d-498b-8fab-43c0fb680403 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:10.326231 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e49b2b5-c47d-498b-8fab-43c0fb680403 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:10.326730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e49b2b5-c47d-498b-8fab-43c0fb680403 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:10.327498 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e49b2b5-c47d-498b-8fab-43c0fb680403 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:10.327935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e49b2b5-c47d-498b-8fab-43c0fb680403 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:10.465811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e49b2b5-c47d-498b-8fab-43c0fb680403 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:10.475173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e49b2b5-c47d-498b-8fab-43c0fb680403 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.159890 May 26 13:25:10.475656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 877/1726] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:10 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:11.492665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94701748-3ee0-4084-85a9-c7a18404961f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:11.493286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94701748-3ee0-4084-85a9-c7a18404961f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:11.500099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94701748-3ee0-4084-85a9-c7a18404961f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:11.500552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94701748-3ee0-4084-85a9-c7a18404961f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:11.501447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94701748-3ee0-4084-85a9-c7a18404961f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:11.501880 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94701748-3ee0-4084-85a9-c7a18404961f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:11.635316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94701748-3ee0-4084-85a9-c7a18404961f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:11.645026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94701748-3ee0-4084-85a9-c7a18404961f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.155660 May 26 13:25:11.645262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 850/1727] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:11 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:12.662936 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b35daa7d-5b5f-4b47-8418-0d8a40225af7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:12.663537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b35daa7d-5b5f-4b47-8418-0d8a40225af7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:12.670098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b35daa7d-5b5f-4b47-8418-0d8a40225af7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:12.670580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b35daa7d-5b5f-4b47-8418-0d8a40225af7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:12.671353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b35daa7d-5b5f-4b47-8418-0d8a40225af7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:12.671783 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b35daa7d-5b5f-4b47-8418-0d8a40225af7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:12.815210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b35daa7d-5b5f-4b47-8418-0d8a40225af7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:12.823601 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b35daa7d-5b5f-4b47-8418-0d8a40225af7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.164685 May 26 13:25:12.824176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 878/1728] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:12 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:13.380866 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:25:13.381111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:25:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:25:13.841770 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72606e0e-a965-4d9d-921b-993d6fdc2e6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:13.842393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72606e0e-a965-4d9d-921b-993d6fdc2e6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:13.851439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72606e0e-a965-4d9d-921b-993d6fdc2e6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:13.851800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72606e0e-a965-4d9d-921b-993d6fdc2e6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:13.852871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72606e0e-a965-4d9d-921b-993d6fdc2e6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:13.853300 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72606e0e-a965-4d9d-921b-993d6fdc2e6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:13.990357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72606e0e-a965-4d9d-921b-993d6fdc2e6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:13.998834 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72606e0e-a965-4d9d-921b-993d6fdc2e6e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.161060 May 26 13:25:13.999429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 851/1729] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:13 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:15.016721 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a179b91e-bd61-4b07-9427-12a8e2feb4ed tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:15.017490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a179b91e-bd61-4b07-9427-12a8e2feb4ed tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:15.024360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a179b91e-bd61-4b07-9427-12a8e2feb4ed tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:15.024817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a179b91e-bd61-4b07-9427-12a8e2feb4ed tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:15.025594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a179b91e-bd61-4b07-9427-12a8e2feb4ed tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:15.026038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a179b91e-bd61-4b07-9427-12a8e2feb4ed tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:15.155799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a179b91e-bd61-4b07-9427-12a8e2feb4ed tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:15.164568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a179b91e-bd61-4b07-9427-12a8e2feb4ed tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.151748 May 26 13:25:15.165141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 879/1730] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:15 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:16.181666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36ec1d47-ca10-4418-8f0a-09bb2bdbc0b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:16.182282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36ec1d47-ca10-4418-8f0a-09bb2bdbc0b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:16.189854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36ec1d47-ca10-4418-8f0a-09bb2bdbc0b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:16.190315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36ec1d47-ca10-4418-8f0a-09bb2bdbc0b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:16.191127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36ec1d47-ca10-4418-8f0a-09bb2bdbc0b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:16.191570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36ec1d47-ca10-4418-8f0a-09bb2bdbc0b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:16.333107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36ec1d47-ca10-4418-8f0a-09bb2bdbc0b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:16.341039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36ec1d47-ca10-4418-8f0a-09bb2bdbc0b7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.163263 May 26 13:25:16.341600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 852/1731] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:16 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:17.359061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-43292380-ffab-4e39-afa3-7632332298cb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:17.359730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-43292380-ffab-4e39-afa3-7632332298cb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:17.366397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43292380-ffab-4e39-afa3-7632332298cb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:17.366879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43292380-ffab-4e39-afa3-7632332298cb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:17.367639 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43292380-ffab-4e39-afa3-7632332298cb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:17.368078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43292380-ffab-4e39-afa3-7632332298cb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:17.502177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-43292380-ffab-4e39-afa3-7632332298cb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:17.510167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-43292380-ffab-4e39-afa3-7632332298cb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.154983 May 26 13:25:17.510763 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 880/1732] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:17 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:18.528908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a105dc12-39ce-4a8c-9227-38113041fe4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:18.529520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a105dc12-39ce-4a8c-9227-38113041fe4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:18.538012 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a105dc12-39ce-4a8c-9227-38113041fe4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:18.538448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a105dc12-39ce-4a8c-9227-38113041fe4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:18.539267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a105dc12-39ce-4a8c-9227-38113041fe4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:18.540193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a105dc12-39ce-4a8c-9227-38113041fe4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:18.672433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a105dc12-39ce-4a8c-9227-38113041fe4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:18.681667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a105dc12-39ce-4a8c-9227-38113041fe4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.156718 May 26 13:25:18.682281 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 853/1733] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:18 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:19.699440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2dd0890-88fe-4ad3-bfdb-54453ce90e06 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:19.700096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2dd0890-88fe-4ad3-bfdb-54453ce90e06 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:19.706929 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2dd0890-88fe-4ad3-bfdb-54453ce90e06 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:19.707389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2dd0890-88fe-4ad3-bfdb-54453ce90e06 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:19.708336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2dd0890-88fe-4ad3-bfdb-54453ce90e06 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:19.708790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2dd0890-88fe-4ad3-bfdb-54453ce90e06 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:19.844268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c2dd0890-88fe-4ad3-bfdb-54453ce90e06 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:19.853233 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2dd0890-88fe-4ad3-bfdb-54453ce90e06 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.157595 May 26 13:25:19.853802 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 881/1734] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:19 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:20.871311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd64635f-e2dd-43ec-a433-aae216b0682d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:20.871942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd64635f-e2dd-43ec-a433-aae216b0682d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:20.878851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd64635f-e2dd-43ec-a433-aae216b0682d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:20.879311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd64635f-e2dd-43ec-a433-aae216b0682d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:20.880121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd64635f-e2dd-43ec-a433-aae216b0682d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:20.880560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd64635f-e2dd-43ec-a433-aae216b0682d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:21.021676 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd64635f-e2dd-43ec-a433-aae216b0682d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:21.029621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd64635f-e2dd-43ec-a433-aae216b0682d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1560 microversion: 2.1 time: 0.162330 May 26 13:25:21.030188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 854/1735] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:20 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:22.047455 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-38ab068b-79b8-481c-9cf2-967464123069 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:22.048115 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-38ab068b-79b8-481c-9cf2-967464123069 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:22.054956 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38ab068b-79b8-481c-9cf2-967464123069 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:22.055520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38ab068b-79b8-481c-9cf2-967464123069 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:22.056377 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38ab068b-79b8-481c-9cf2-967464123069 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:22.056912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38ab068b-79b8-481c-9cf2-967464123069 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:22.076051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c4fb7b41-e080-4602-b4e8-1f97966c5d7f req-c98b5493-111a-4921-a7a2-965536c45aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03f3c20-ca70-497d-a163-d7c152799be2", "name": "network-vif-deleted", "tag": "6d4892f1-7c31-4c2e-af66-724484c5f5dc"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:25:22.085206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c4fb7b41-e080-4602-b4e8-1f97966c5d7f req-c98b5493-111a-4921-a7a2-965536c45aa0 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:22.088160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c4fb7b41-e080-4602-b4e8-1f97966c5d7f req-c98b5493-111a-4921-a7a2-965536c45aa0 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:22.098975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c4fb7b41-e080-4602-b4e8-1f97966c5d7f req-c98b5493-111a-4921-a7a2-965536c45aa0 service nova] Creating event network-vif-deleted:6d4892f1-7c31-4c2e-af66-724484c5f5dc for instance a03f3c20-ca70-497d-a163-d7c152799be2 on hv-cinder-81514 May 26 13:25:22.115004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-c4fb7b41-e080-4602-b4e8-1f97966c5d7f req-c98b5493-111a-4921-a7a2-965536c45aa0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109906 May 26 13:25:22.116317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 882/1736] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:25:22.127692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-38ab068b-79b8-481c-9cf2-967464123069 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:22.140717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-38ab068b-79b8-481c-9cf2-967464123069 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1518 microversion: 2.1 time: 0.097029 May 26 13:25:22.142119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 855/1737] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:22 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1518 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:23.159903 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1655a76-1b0f-4ed0-8a44-2446987f5576 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:23.161246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1655a76-1b0f-4ed0-8a44-2446987f5576 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:23.167676 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1655a76-1b0f-4ed0-8a44-2446987f5576 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:23.168125 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1655a76-1b0f-4ed0-8a44-2446987f5576 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:23.168886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1655a76-1b0f-4ed0-8a44-2446987f5576 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:23.169319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1655a76-1b0f-4ed0-8a44-2446987f5576 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:23.233236 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1655a76-1b0f-4ed0-8a44-2446987f5576 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:23.242126 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1655a76-1b0f-4ed0-8a44-2446987f5576 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086887 May 26 13:25:23.242784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 883/1738] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:23 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:24.259974 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7db21b42-7b20-4946-88c1-194c8ceba152 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:24.260558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7db21b42-7b20-4946-88c1-194c8ceba152 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:24.267787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7db21b42-7b20-4946-88c1-194c8ceba152 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:24.268234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7db21b42-7b20-4946-88c1-194c8ceba152 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:24.269006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7db21b42-7b20-4946-88c1-194c8ceba152 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:24.269436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7db21b42-7b20-4946-88c1-194c8ceba152 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:24.332227 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7db21b42-7b20-4946-88c1-194c8ceba152 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:24.341038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7db21b42-7b20-4946-88c1-194c8ceba152 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085231 May 26 13:25:24.341603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 856/1739] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:24 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:25.359036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd66f4a3-56be-4a18-82dd-6f2dcdafdd4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:25.359657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd66f4a3-56be-4a18-82dd-6f2dcdafdd4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:25.362198 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:25.367303 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd66f4a3-56be-4a18-82dd-6f2dcdafdd4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:25.367755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd66f4a3-56be-4a18-82dd-6f2dcdafdd4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:25.368526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd66f4a3-56be-4a18-82dd-6f2dcdafdd4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:25.368967 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd66f4a3-56be-4a18-82dd-6f2dcdafdd4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:25.372996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=80 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:25.432454 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd66f4a3-56be-4a18-82dd-6f2dcdafdd4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:25.440704 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd66f4a3-56be-4a18-82dd-6f2dcdafdd4c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085565 May 26 13:25:25.441270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 884/1740] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:25 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:26.458789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-adedb68e-a42f-4bbb-aafb-ab611a30444b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:26.459459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-adedb68e-a42f-4bbb-aafb-ab611a30444b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:26.462498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:26.467314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adedb68e-a42f-4bbb-aafb-ab611a30444b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:26.467772 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adedb68e-a42f-4bbb-aafb-ab611a30444b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:26.468676 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adedb68e-a42f-4bbb-aafb-ab611a30444b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:26.469004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adedb68e-a42f-4bbb-aafb-ab611a30444b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:26.471770 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:26.533667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-adedb68e-a42f-4bbb-aafb-ab611a30444b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:26.542683 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-adedb68e-a42f-4bbb-aafb-ab611a30444b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087843 May 26 13:25:26.543255 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 857/1741] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:26 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:27.560432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b7bac79d-358c-4a5e-a8ea-856cca30f17c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:27.561013 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b7bac79d-358c-4a5e-a8ea-856cca30f17c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:27.567575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7bac79d-358c-4a5e-a8ea-856cca30f17c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:27.568033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7bac79d-358c-4a5e-a8ea-856cca30f17c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:27.568811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7bac79d-358c-4a5e-a8ea-856cca30f17c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:27.569258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7bac79d-358c-4a5e-a8ea-856cca30f17c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:27.630464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b7bac79d-358c-4a5e-a8ea-856cca30f17c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:27.639109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b7bac79d-358c-4a5e-a8ea-856cca30f17c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083290 May 26 13:25:27.639707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 885/1742] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:27 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:28.656401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-902daeff-69a0-43c2-b80f-c73f5bb57221 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:28.657000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-902daeff-69a0-43c2-b80f-c73f5bb57221 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:28.663817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-902daeff-69a0-43c2-b80f-c73f5bb57221 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:28.664273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-902daeff-69a0-43c2-b80f-c73f5bb57221 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:28.665044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-902daeff-69a0-43c2-b80f-c73f5bb57221 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:28.665487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-902daeff-69a0-43c2-b80f-c73f5bb57221 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:28.730267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-902daeff-69a0-43c2-b80f-c73f5bb57221 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:28.738401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-902daeff-69a0-43c2-b80f-c73f5bb57221 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086429 May 26 13:25:28.739002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 858/1743] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:28 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:29.756125 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-36a62973-3d40-46a6-9a8f-6b516e5d657c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:29.756732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-36a62973-3d40-46a6-9a8f-6b516e5d657c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:29.764003 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36a62973-3d40-46a6-9a8f-6b516e5d657c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:29.764470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36a62973-3d40-46a6-9a8f-6b516e5d657c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:29.765295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36a62973-3d40-46a6-9a8f-6b516e5d657c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:29.765826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36a62973-3d40-46a6-9a8f-6b516e5d657c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:29.833778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-36a62973-3d40-46a6-9a8f-6b516e5d657c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:29.841926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-36a62973-3d40-46a6-9a8f-6b516e5d657c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.089676 May 26 13:25:29.842493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 886/1744] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:29 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:30.859796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1a4eeac8-a02c-4f07-830b-77147494ac14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:30.860355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1a4eeac8-a02c-4f07-830b-77147494ac14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:30.867376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4eeac8-a02c-4f07-830b-77147494ac14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:30.867833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4eeac8-a02c-4f07-830b-77147494ac14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:30.868604 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4eeac8-a02c-4f07-830b-77147494ac14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:30.869060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4eeac8-a02c-4f07-830b-77147494ac14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:30.931372 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a4eeac8-a02c-4f07-830b-77147494ac14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:30.939783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1a4eeac8-a02c-4f07-830b-77147494ac14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083910 May 26 13:25:30.940340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 859/1745] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:30 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:31.957707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d52a1fc-90ac-4a2e-a83c-468abe5e7d5d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:31.958427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d52a1fc-90ac-4a2e-a83c-468abe5e7d5d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:31.965311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d52a1fc-90ac-4a2e-a83c-468abe5e7d5d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:31.965762 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d52a1fc-90ac-4a2e-a83c-468abe5e7d5d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:31.966547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d52a1fc-90ac-4a2e-a83c-468abe5e7d5d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:31.966997 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d52a1fc-90ac-4a2e-a83c-468abe5e7d5d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:32.033588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d52a1fc-90ac-4a2e-a83c-468abe5e7d5d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:32.042799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d52a1fc-90ac-4a2e-a83c-468abe5e7d5d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.089034 May 26 13:25:32.043360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 887/1746] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:31 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:33.059633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-577cfc49-7dcc-42b7-9a5a-3ed113c56179 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:33.060259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-577cfc49-7dcc-42b7-9a5a-3ed113c56179 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:33.067623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-577cfc49-7dcc-42b7-9a5a-3ed113c56179 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:33.068076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-577cfc49-7dcc-42b7-9a5a-3ed113c56179 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:33.068850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-577cfc49-7dcc-42b7-9a5a-3ed113c56179 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:33.069292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-577cfc49-7dcc-42b7-9a5a-3ed113c56179 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:33.132467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-577cfc49-7dcc-42b7-9a5a-3ed113c56179 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:33.140749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-577cfc49-7dcc-42b7-9a5a-3ed113c56179 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084951 May 26 13:25:33.141303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 860/1747] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:33 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:34.159966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c5fc9ea4-4141-4e54-a3e7-0331978347b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:34.160651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c5fc9ea4-4141-4e54-a3e7-0331978347b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:34.167984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5fc9ea4-4141-4e54-a3e7-0331978347b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:34.168429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5fc9ea4-4141-4e54-a3e7-0331978347b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:34.169212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5fc9ea4-4141-4e54-a3e7-0331978347b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:34.169693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5fc9ea4-4141-4e54-a3e7-0331978347b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:34.232479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c5fc9ea4-4141-4e54-a3e7-0331978347b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:34.240524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c5fc9ea4-4141-4e54-a3e7-0331978347b4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086694 May 26 13:25:34.241085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 888/1748] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:34 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:35.258656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ace38ab-c32c-400d-9e67-5bdb5155b816 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:35.259223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ace38ab-c32c-400d-9e67-5bdb5155b816 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:35.266442 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ace38ab-c32c-400d-9e67-5bdb5155b816 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:35.266922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ace38ab-c32c-400d-9e67-5bdb5155b816 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:35.267703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ace38ab-c32c-400d-9e67-5bdb5155b816 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:35.268149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ace38ab-c32c-400d-9e67-5bdb5155b816 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:35.332026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ace38ab-c32c-400d-9e67-5bdb5155b816 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:35.340020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ace38ab-c32c-400d-9e67-5bdb5155b816 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085476 May 26 13:25:35.340627 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 861/1749] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:35 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:36.358634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37eb37fb-ddc6-4aca-b143-eca891096bf4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:36.359267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37eb37fb-ddc6-4aca-b143-eca891096bf4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:36.366085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37eb37fb-ddc6-4aca-b143-eca891096bf4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:36.366564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37eb37fb-ddc6-4aca-b143-eca891096bf4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:36.367336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37eb37fb-ddc6-4aca-b143-eca891096bf4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:36.367774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37eb37fb-ddc6-4aca-b143-eca891096bf4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:36.430931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37eb37fb-ddc6-4aca-b143-eca891096bf4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:36.439965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37eb37fb-ddc6-4aca-b143-eca891096bf4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085918 May 26 13:25:36.440524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 889/1750] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:36 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:37.458322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d264d977-34cf-480d-b631-33c739dc2324 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:37.458967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d264d977-34cf-480d-b631-33c739dc2324 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:37.465582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d264d977-34cf-480d-b631-33c739dc2324 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:37.466343 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d264d977-34cf-480d-b631-33c739dc2324 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:37.467299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d264d977-34cf-480d-b631-33c739dc2324 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:37.467690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d264d977-34cf-480d-b631-33c739dc2324 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:37.531600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d264d977-34cf-480d-b631-33c739dc2324 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:37.539661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d264d977-34cf-480d-b631-33c739dc2324 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085499 May 26 13:25:37.540612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 862/1751] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:37 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:38.557397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-525efec0-6fe2-4ad5-9245-7114bbd189d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:38.557947 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-525efec0-6fe2-4ad5-9245-7114bbd189d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:38.564488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-525efec0-6fe2-4ad5-9245-7114bbd189d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:38.564931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-525efec0-6fe2-4ad5-9245-7114bbd189d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:38.565693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-525efec0-6fe2-4ad5-9245-7114bbd189d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:38.566128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-525efec0-6fe2-4ad5-9245-7114bbd189d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:38.630752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-525efec0-6fe2-4ad5-9245-7114bbd189d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:38.638980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-525efec0-6fe2-4ad5-9245-7114bbd189d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085579 May 26 13:25:38.639536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 890/1752] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:38 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:39.657569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-545d0098-f50b-494e-bec3-bd21d0e7fe32 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:39.658160 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-545d0098-f50b-494e-bec3-bd21d0e7fe32 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:39.664851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-545d0098-f50b-494e-bec3-bd21d0e7fe32 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:39.665299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-545d0098-f50b-494e-bec3-bd21d0e7fe32 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:39.666067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-545d0098-f50b-494e-bec3-bd21d0e7fe32 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:39.666544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-545d0098-f50b-494e-bec3-bd21d0e7fe32 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:39.729459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-545d0098-f50b-494e-bec3-bd21d0e7fe32 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:39.738831 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-545d0098-f50b-494e-bec3-bd21d0e7fe32 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085575 May 26 13:25:39.739404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 863/1753] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:39 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:40.755750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5bae6e07-dba1-4d0b-a169-2110b6565044 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:40.756355 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5bae6e07-dba1-4d0b-a169-2110b6565044 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:40.763062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bae6e07-dba1-4d0b-a169-2110b6565044 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:40.763512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bae6e07-dba1-4d0b-a169-2110b6565044 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:40.764289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bae6e07-dba1-4d0b-a169-2110b6565044 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:40.764731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bae6e07-dba1-4d0b-a169-2110b6565044 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:41.081451 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5bae6e07-dba1-4d0b-a169-2110b6565044 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:41.089550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5bae6e07-dba1-4d0b-a169-2110b6565044 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.337741 May 26 13:25:41.090118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 891/1754] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:40 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:42.107308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e9c13d8-4033-42b0-b55a-748a614a4347 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:42.107855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e9c13d8-4033-42b0-b55a-748a614a4347 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:42.115322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e9c13d8-4033-42b0-b55a-748a614a4347 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:42.115780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e9c13d8-4033-42b0-b55a-748a614a4347 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:42.116568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e9c13d8-4033-42b0-b55a-748a614a4347 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:42.117011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e9c13d8-4033-42b0-b55a-748a614a4347 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:42.182266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e9c13d8-4033-42b0-b55a-748a614a4347 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:42.190663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e9c13d8-4033-42b0-b55a-748a614a4347 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087329 May 26 13:25:42.191238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 864/1755] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:42 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:43.208238 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb9b2a79-0de3-4141-a04b-36058365381a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:43.208863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb9b2a79-0de3-4141-a04b-36058365381a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:43.216543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb9b2a79-0de3-4141-a04b-36058365381a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:43.217029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb9b2a79-0de3-4141-a04b-36058365381a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:43.217814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb9b2a79-0de3-4141-a04b-36058365381a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:43.218331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb9b2a79-0de3-4141-a04b-36058365381a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:43.281523 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cb9b2a79-0de3-4141-a04b-36058365381a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:43.290159 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb9b2a79-0de3-4141-a04b-36058365381a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085691 May 26 13:25:43.290780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 892/1756] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:43 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:44.307774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-645aa465-ed3e-4525-872a-6283eab0e1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:44.308495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-645aa465-ed3e-4525-872a-6283eab0e1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:44.315485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-645aa465-ed3e-4525-872a-6283eab0e1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:44.315943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-645aa465-ed3e-4525-872a-6283eab0e1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:44.316728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-645aa465-ed3e-4525-872a-6283eab0e1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:44.317190 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-645aa465-ed3e-4525-872a-6283eab0e1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:44.380100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-645aa465-ed3e-4525-872a-6283eab0e1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:44.388224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-645aa465-ed3e-4525-872a-6283eab0e1e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084356 May 26 13:25:44.388798 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 865/1757] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:44 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:45.406047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bcbc2060-f75d-4b7a-8dc3-f2e9ae747428 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:45.407237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bcbc2060-f75d-4b7a-8dc3-f2e9ae747428 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:45.413878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcbc2060-f75d-4b7a-8dc3-f2e9ae747428 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:45.414321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcbc2060-f75d-4b7a-8dc3-f2e9ae747428 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:45.415120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcbc2060-f75d-4b7a-8dc3-f2e9ae747428 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:45.415623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcbc2060-f75d-4b7a-8dc3-f2e9ae747428 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:45.477018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcbc2060-f75d-4b7a-8dc3-f2e9ae747428 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:45.485484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bcbc2060-f75d-4b7a-8dc3-f2e9ae747428 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083566 May 26 13:25:45.486046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 893/1758] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:45 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:46.502756 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ffb60e0-6213-4110-a2a6-fb36a427061e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:46.503515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ffb60e0-6213-4110-a2a6-fb36a427061e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:46.511937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ffb60e0-6213-4110-a2a6-fb36a427061e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:46.512402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ffb60e0-6213-4110-a2a6-fb36a427061e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:46.513193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ffb60e0-6213-4110-a2a6-fb36a427061e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:46.513641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ffb60e0-6213-4110-a2a6-fb36a427061e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:46.589686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ffb60e0-6213-4110-a2a6-fb36a427061e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:46.599482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ffb60e0-6213-4110-a2a6-fb36a427061e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.101301 May 26 13:25:46.600068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 866/1759] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:46 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:47.621455 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-903fcd02-7090-4cff-ad0e-315adb5d472e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:47.622073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-903fcd02-7090-4cff-ad0e-315adb5d472e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:47.631949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-903fcd02-7090-4cff-ad0e-315adb5d472e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:47.632746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-903fcd02-7090-4cff-ad0e-315adb5d472e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:47.633863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-903fcd02-7090-4cff-ad0e-315adb5d472e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:47.634301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-903fcd02-7090-4cff-ad0e-315adb5d472e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:47.709317 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-903fcd02-7090-4cff-ad0e-315adb5d472e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:47.717658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-903fcd02-7090-4cff-ad0e-315adb5d472e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.100322 May 26 13:25:47.718270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 894/1760] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:47 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:25:48.735363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b4a7b5d3-9f6b-430b-9c94-721f0c2e13e4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:48.736129 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b4a7b5d3-9f6b-430b-9c94-721f0c2e13e4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:48.742848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4a7b5d3-9f6b-430b-9c94-721f0c2e13e4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:48.743302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4a7b5d3-9f6b-430b-9c94-721f0c2e13e4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:48.744114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4a7b5d3-9f6b-430b-9c94-721f0c2e13e4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:48.744553 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4a7b5d3-9f6b-430b-9c94-721f0c2e13e4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:48.856651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4a7b5d3-9f6b-430b-9c94-721f0c2e13e4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:48.856651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b4a7b5d3-9f6b-430b-9c94-721f0c2e13e4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.089022 May 26 13:25:48.856651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 867/1761] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:48 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:49.864346 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-304eef8f-9c14-4f3c-baea-e8ea0d43511c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:49.864970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-304eef8f-9c14-4f3c-baea-e8ea0d43511c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:49.871446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-304eef8f-9c14-4f3c-baea-e8ea0d43511c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:49.871890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-304eef8f-9c14-4f3c-baea-e8ea0d43511c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:49.872651 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-304eef8f-9c14-4f3c-baea-e8ea0d43511c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:49.873083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-304eef8f-9c14-4f3c-baea-e8ea0d43511c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:49.937942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-304eef8f-9c14-4f3c-baea-e8ea0d43511c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:49.947136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-304eef8f-9c14-4f3c-baea-e8ea0d43511c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086628 May 26 13:25:49.947705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 895/1762] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:49 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:50.965647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-993e95b8-a810-4661-9641-bb934aecf790 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:50.966257 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-993e95b8-a810-4661-9641-bb934aecf790 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:50.973696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-993e95b8-a810-4661-9641-bb934aecf790 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:50.974279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-993e95b8-a810-4661-9641-bb934aecf790 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:50.975112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-993e95b8-a810-4661-9641-bb934aecf790 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:50.975642 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-993e95b8-a810-4661-9641-bb934aecf790 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:51.041573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-993e95b8-a810-4661-9641-bb934aecf790 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:51.050335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-993e95b8-a810-4661-9641-bb934aecf790 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.088912 May 26 13:25:51.051040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 868/1763] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:50 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:52.070503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f919bf6-befe-4fb5-97ea-059396d4dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:52.071145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f919bf6-befe-4fb5-97ea-059396d4dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:52.077734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f919bf6-befe-4fb5-97ea-059396d4dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:52.078190 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f919bf6-befe-4fb5-97ea-059396d4dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:52.079885 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f919bf6-befe-4fb5-97ea-059396d4dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:52.080572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f919bf6-befe-4fb5-97ea-059396d4dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:52.145154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f919bf6-befe-4fb5-97ea-059396d4dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:52.153895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f919bf6-befe-4fb5-97ea-059396d4dd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.089557 May 26 13:25:52.154460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 896/1764] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:52 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:53.176333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f02d52ea-9153-4c2f-82bd-f7e3849e152d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:53.176946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f02d52ea-9153-4c2f-82bd-f7e3849e152d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:53.185114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f02d52ea-9153-4c2f-82bd-f7e3849e152d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:53.185715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f02d52ea-9153-4c2f-82bd-f7e3849e152d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:53.186493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f02d52ea-9153-4c2f-82bd-f7e3849e152d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:53.186960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f02d52ea-9153-4c2f-82bd-f7e3849e152d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:53.249324 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f02d52ea-9153-4c2f-82bd-f7e3849e152d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:53.257904 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f02d52ea-9153-4c2f-82bd-f7e3849e152d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086010 May 26 13:25:53.258574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 869/1765] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:53 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:54.276426 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8942e5e-46c6-48b5-bd7a-3fdd3ba853f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:54.277041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8942e5e-46c6-48b5-bd7a-3fdd3ba853f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:54.284380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8942e5e-46c6-48b5-bd7a-3fdd3ba853f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:54.284832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8942e5e-46c6-48b5-bd7a-3fdd3ba853f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:54.285606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8942e5e-46c6-48b5-bd7a-3fdd3ba853f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:54.286046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8942e5e-46c6-48b5-bd7a-3fdd3ba853f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:54.347461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f8942e5e-46c6-48b5-bd7a-3fdd3ba853f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:54.355708 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8942e5e-46c6-48b5-bd7a-3fdd3ba853f0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083492 May 26 13:25:54.356273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 897/1766] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:54 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:55.372273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b226ef25-be8e-43e4-bf57-15cd31b54df2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:55.372875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b226ef25-be8e-43e4-bf57-15cd31b54df2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:55.380229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b226ef25-be8e-43e4-bf57-15cd31b54df2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:55.380690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b226ef25-be8e-43e4-bf57-15cd31b54df2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:55.381467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b226ef25-be8e-43e4-bf57-15cd31b54df2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:55.381907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b226ef25-be8e-43e4-bf57-15cd31b54df2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:55.446167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b226ef25-be8e-43e4-bf57-15cd31b54df2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:55.454914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b226ef25-be8e-43e4-bf57-15cd31b54df2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085785 May 26 13:25:55.455578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 870/1767] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:55 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:56.472917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-26ef19dc-cf37-490c-8857-901a61911d7e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:56.473507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-26ef19dc-cf37-490c-8857-901a61911d7e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:56.475927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:56.481015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26ef19dc-cf37-490c-8857-901a61911d7e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:56.481471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26ef19dc-cf37-490c-8857-901a61911d7e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:56.482242 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26ef19dc-cf37-490c-8857-901a61911d7e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:56.482719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26ef19dc-cf37-490c-8857-901a61911d7e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:56.487228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:56.545446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-26ef19dc-cf37-490c-8857-901a61911d7e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:56.554495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-26ef19dc-cf37-490c-8857-901a61911d7e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085758 May 26 13:25:56.555105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 898/1768] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:56 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:57.571964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d9a0d3af-c88c-4dfd-9228-4e6dbd966bb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:57.572582 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d9a0d3af-c88c-4dfd-9228-4e6dbd966bb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:57.575053 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:57.580237 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9a0d3af-c88c-4dfd-9228-4e6dbd966bb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:57.580631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9a0d3af-c88c-4dfd-9228-4e6dbd966bb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:57.581536 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9a0d3af-c88c-4dfd-9228-4e6dbd966bb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:57.581984 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9a0d3af-c88c-4dfd-9228-4e6dbd966bb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:57.646090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9a0d3af-c88c-4dfd-9228-4e6dbd966bb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:57.654950 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d9a0d3af-c88c-4dfd-9228-4e6dbd966bb0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086737 May 26 13:25:57.655591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 871/1769] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:57 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:58.021223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:25:58.021508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:25:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:25:58.675062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fead6b92-b498-4be4-80be-a24c5468f2b0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:58.675732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fead6b92-b498-4be4-80be-a24c5468f2b0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:58.682427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fead6b92-b498-4be4-80be-a24c5468f2b0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:58.682906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fead6b92-b498-4be4-80be-a24c5468f2b0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:58.686847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fead6b92-b498-4be4-80be-a24c5468f2b0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:58.686847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fead6b92-b498-4be4-80be-a24c5468f2b0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:58.749689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fead6b92-b498-4be4-80be-a24c5468f2b0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:58.758650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fead6b92-b498-4be4-80be-a24c5468f2b0 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.088041 May 26 13:25:58.759223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 899/1770] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:58 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:25:59.776567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8e086d83-2d23-4440-ade8-2221fe9ccc43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:25:59.777183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8e086d83-2d23-4440-ade8-2221fe9ccc43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:25:59.784717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e086d83-2d23-4440-ade8-2221fe9ccc43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:59.785549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e086d83-2d23-4440-ade8-2221fe9ccc43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:59.786332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e086d83-2d23-4440-ade8-2221fe9ccc43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:25:59.786948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e086d83-2d23-4440-ade8-2221fe9ccc43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:25:59.789601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=90 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:59.851604 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8e086d83-2d23-4440-ade8-2221fe9ccc43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:25:59.860033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8e086d83-2d23-4440-ade8-2221fe9ccc43 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087400 May 26 13:25:59.860601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 872/1771] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:25:59 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:00.877480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6854ea40-1e8c-4255-ad06-82e2e4eb5e7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:00.878329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6854ea40-1e8c-4255-ad06-82e2e4eb5e7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:00.884904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6854ea40-1e8c-4255-ad06-82e2e4eb5e7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:00.885350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6854ea40-1e8c-4255-ad06-82e2e4eb5e7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:00.886111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6854ea40-1e8c-4255-ad06-82e2e4eb5e7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:00.886569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6854ea40-1e8c-4255-ad06-82e2e4eb5e7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:00.948508 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6854ea40-1e8c-4255-ad06-82e2e4eb5e7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:00.957164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6854ea40-1e8c-4255-ad06-82e2e4eb5e7a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083762 May 26 13:26:00.957720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 900/1772] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:00 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:01.976935 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc93c4cc-58e6-44b0-bef4-6299f8fb1dc6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:01.977802 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc93c4cc-58e6-44b0-bef4-6299f8fb1dc6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:01.984423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc93c4cc-58e6-44b0-bef4-6299f8fb1dc6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:01.984874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc93c4cc-58e6-44b0-bef4-6299f8fb1dc6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:01.985637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc93c4cc-58e6-44b0-bef4-6299f8fb1dc6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:01.986074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc93c4cc-58e6-44b0-bef4-6299f8fb1dc6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:02.052292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc93c4cc-58e6-44b0-bef4-6299f8fb1dc6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:02.061735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc93c4cc-58e6-44b0-bef4-6299f8fb1dc6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.088671 May 26 13:26:02.062294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 873/1773] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:01 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:03.079507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c4529d99-753c-4ae3-a632-41fd0ae02805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:03.080429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4529d99-753c-4ae3-a632-41fd0ae02805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:03.088134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4529d99-753c-4ae3-a632-41fd0ae02805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:03.088582 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4529d99-753c-4ae3-a632-41fd0ae02805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:03.089389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4529d99-753c-4ae3-a632-41fd0ae02805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:03.089827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4529d99-753c-4ae3-a632-41fd0ae02805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:03.156140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4529d99-753c-4ae3-a632-41fd0ae02805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:03.170905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c4529d99-753c-4ae3-a632-41fd0ae02805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.095098 May 26 13:26:03.171790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 901/1774] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:03 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:26:04.189941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-30872a49-ee39-4c15-8700-7106eec856eb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:04.191014 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-30872a49-ee39-4c15-8700-7106eec856eb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:04.197763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30872a49-ee39-4c15-8700-7106eec856eb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:04.198205 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30872a49-ee39-4c15-8700-7106eec856eb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:04.199010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30872a49-ee39-4c15-8700-7106eec856eb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:04.199444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30872a49-ee39-4c15-8700-7106eec856eb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:04.267573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-30872a49-ee39-4c15-8700-7106eec856eb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:04.277872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-30872a49-ee39-4c15-8700-7106eec856eb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.092125 May 26 13:26:04.278442 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 874/1775] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:04 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:04.973521 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:26:04.973806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:26:05.296065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d20c2bee-9298-49ca-bcd2-1f97cc9ca082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:05.296685 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d20c2bee-9298-49ca-bcd2-1f97cc9ca082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:05.304008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d20c2bee-9298-49ca-bcd2-1f97cc9ca082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:05.304465 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d20c2bee-9298-49ca-bcd2-1f97cc9ca082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:05.305251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d20c2bee-9298-49ca-bcd2-1f97cc9ca082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:05.305720 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d20c2bee-9298-49ca-bcd2-1f97cc9ca082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:05.368453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d20c2bee-9298-49ca-bcd2-1f97cc9ca082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:05.376654 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d20c2bee-9298-49ca-bcd2-1f97cc9ca082 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084453 May 26 13:26:05.377212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 902/1776] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:05 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:06.393128 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7d0267ca-25be-4050-89c2-fde31d34ca46 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:06.393752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7d0267ca-25be-4050-89c2-fde31d34ca46 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:06.400928 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d0267ca-25be-4050-89c2-fde31d34ca46 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:06.401383 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d0267ca-25be-4050-89c2-fde31d34ca46 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:06.402149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d0267ca-25be-4050-89c2-fde31d34ca46 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:06.402617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d0267ca-25be-4050-89c2-fde31d34ca46 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:06.464495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7d0267ca-25be-4050-89c2-fde31d34ca46 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:06.473294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7d0267ca-25be-4050-89c2-fde31d34ca46 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083552 May 26 13:26:06.474107 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 875/1777] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:06 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:07.491584 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bd7dbe2-88ec-46b7-8b16-7306f67d9fb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:07.492172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bd7dbe2-88ec-46b7-8b16-7306f67d9fb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:07.498825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe2-88ec-46b7-8b16-7306f67d9fb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:07.499277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe2-88ec-46b7-8b16-7306f67d9fb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:07.500044 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe2-88ec-46b7-8b16-7306f67d9fb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:07.500485 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe2-88ec-46b7-8b16-7306f67d9fb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:07.565769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bd7dbe2-88ec-46b7-8b16-7306f67d9fb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:07.574437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bd7dbe2-88ec-46b7-8b16-7306f67d9fb9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087360 May 26 13:26:07.575031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 903/1778] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:07 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:08.591964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c4b7f3b1-52e6-4382-aa8e-b03b4e49f026 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:08.592541 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c4b7f3b1-52e6-4382-aa8e-b03b4e49f026 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:08.600259 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b7f3b1-52e6-4382-aa8e-b03b4e49f026 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:08.600725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b7f3b1-52e6-4382-aa8e-b03b4e49f026 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:08.601494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b7f3b1-52e6-4382-aa8e-b03b4e49f026 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:08.601939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b7f3b1-52e6-4382-aa8e-b03b4e49f026 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:08.664896 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4b7f3b1-52e6-4382-aa8e-b03b4e49f026 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:08.672861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c4b7f3b1-52e6-4382-aa8e-b03b4e49f026 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084927 May 26 13:26:08.673420 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 876/1779] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:08 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:09.690395 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-78db6b3b-714e-4b3a-82e3-3a21b6e1e5d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:09.691081 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-78db6b3b-714e-4b3a-82e3-3a21b6e1e5d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:09.698516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78db6b3b-714e-4b3a-82e3-3a21b6e1e5d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:09.699011 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78db6b3b-714e-4b3a-82e3-3a21b6e1e5d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:09.699792 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78db6b3b-714e-4b3a-82e3-3a21b6e1e5d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:09.700259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78db6b3b-714e-4b3a-82e3-3a21b6e1e5d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:09.763031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78db6b3b-714e-4b3a-82e3-3a21b6e1e5d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:09.772245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-78db6b3b-714e-4b3a-82e3-3a21b6e1e5d2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085644 May 26 13:26:09.772830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 904/1780] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:09 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:10.793731 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e3d47c6-c49d-4aca-8750-61746eb17856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:10.794369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e3d47c6-c49d-4aca-8750-61746eb17856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:10.801285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e3d47c6-c49d-4aca-8750-61746eb17856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:10.802356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e3d47c6-c49d-4aca-8750-61746eb17856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:10.803179 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e3d47c6-c49d-4aca-8750-61746eb17856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:10.803627 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e3d47c6-c49d-4aca-8750-61746eb17856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:10.869019 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e3d47c6-c49d-4aca-8750-61746eb17856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:10.877121 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e3d47c6-c49d-4aca-8750-61746eb17856 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087336 May 26 13:26:10.877693 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 877/1781] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:10 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:11.895035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ad66fb7f-e7a3-4de0-ba50-5c8eb1e8d80c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:11.896223 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ad66fb7f-e7a3-4de0-ba50-5c8eb1e8d80c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:11.904009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad66fb7f-e7a3-4de0-ba50-5c8eb1e8d80c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:11.904009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad66fb7f-e7a3-4de0-ba50-5c8eb1e8d80c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:11.905113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad66fb7f-e7a3-4de0-ba50-5c8eb1e8d80c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:11.905113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad66fb7f-e7a3-4de0-ba50-5c8eb1e8d80c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:11.967028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ad66fb7f-e7a3-4de0-ba50-5c8eb1e8d80c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:11.975722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ad66fb7f-e7a3-4de0-ba50-5c8eb1e8d80c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084677 May 26 13:26:11.976296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 905/1782] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:11 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:12.993372 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b207e5a8-c38c-41d2-bbf3-6905012522c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:12.993994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b207e5a8-c38c-41d2-bbf3-6905012522c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:13.000580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b207e5a8-c38c-41d2-bbf3-6905012522c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:13.001011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b207e5a8-c38c-41d2-bbf3-6905012522c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:13.001786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b207e5a8-c38c-41d2-bbf3-6905012522c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:13.002225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b207e5a8-c38c-41d2-bbf3-6905012522c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:13.065780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b207e5a8-c38c-41d2-bbf3-6905012522c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:13.074750 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b207e5a8-c38c-41d2-bbf3-6905012522c6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085593 May 26 13:26:13.075326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 878/1783] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:12 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:14.092297 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5823b2a9-31d2-48fc-87c9-ec23cdafc17b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:14.092900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5823b2a9-31d2-48fc-87c9-ec23cdafc17b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:14.099960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5823b2a9-31d2-48fc-87c9-ec23cdafc17b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:14.100448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5823b2a9-31d2-48fc-87c9-ec23cdafc17b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:14.101254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5823b2a9-31d2-48fc-87c9-ec23cdafc17b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:14.101714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5823b2a9-31d2-48fc-87c9-ec23cdafc17b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:14.164377 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5823b2a9-31d2-48fc-87c9-ec23cdafc17b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:14.172383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5823b2a9-31d2-48fc-87c9-ec23cdafc17b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084025 May 26 13:26:14.172954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 906/1784] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:14 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:15.190993 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ddd20c5-78eb-4fff-8235-7ca1892e2b1c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:15.191625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ddd20c5-78eb-4fff-8235-7ca1892e2b1c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:15.198171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ddd20c5-78eb-4fff-8235-7ca1892e2b1c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:15.198657 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ddd20c5-78eb-4fff-8235-7ca1892e2b1c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:15.199429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ddd20c5-78eb-4fff-8235-7ca1892e2b1c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:15.199863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ddd20c5-78eb-4fff-8235-7ca1892e2b1c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:15.265565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9ddd20c5-78eb-4fff-8235-7ca1892e2b1c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:15.274243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ddd20c5-78eb-4fff-8235-7ca1892e2b1c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087094 May 26 13:26:15.274864 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 879/1785] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:15 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:16.291953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b96ffd2-0bc5-48f3-9862-ff828dccf515 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:16.292707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b96ffd2-0bc5-48f3-9862-ff828dccf515 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:16.299240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b96ffd2-0bc5-48f3-9862-ff828dccf515 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:16.299700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b96ffd2-0bc5-48f3-9862-ff828dccf515 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:16.300475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b96ffd2-0bc5-48f3-9862-ff828dccf515 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:16.300918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b96ffd2-0bc5-48f3-9862-ff828dccf515 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:16.366275 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b96ffd2-0bc5-48f3-9862-ff828dccf515 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:16.374365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b96ffd2-0bc5-48f3-9862-ff828dccf515 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087038 May 26 13:26:16.374957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 907/1786] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:16 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:17.391922 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9bd7f1af-7b4a-40af-8d01-f5d222bf0678 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:17.392569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9bd7f1af-7b4a-40af-8d01-f5d222bf0678 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:17.399070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bd7f1af-7b4a-40af-8d01-f5d222bf0678 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:17.399515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bd7f1af-7b4a-40af-8d01-f5d222bf0678 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:17.400277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bd7f1af-7b4a-40af-8d01-f5d222bf0678 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:17.400710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bd7f1af-7b4a-40af-8d01-f5d222bf0678 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:17.463470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9bd7f1af-7b4a-40af-8d01-f5d222bf0678 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:17.471345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9bd7f1af-7b4a-40af-8d01-f5d222bf0678 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083319 May 26 13:26:17.471905 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 880/1787] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:17 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:18.488205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65af9530-c676-4421-bded-a0b135948f7f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:18.488829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65af9530-c676-4421-bded-a0b135948f7f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:18.495794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65af9530-c676-4421-bded-a0b135948f7f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:18.496243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65af9530-c676-4421-bded-a0b135948f7f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:18.497046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65af9530-c676-4421-bded-a0b135948f7f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:18.497478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65af9530-c676-4421-bded-a0b135948f7f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:18.562385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-65af9530-c676-4421-bded-a0b135948f7f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:18.571263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65af9530-c676-4421-bded-a0b135948f7f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086920 May 26 13:26:18.571848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 908/1788] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:18 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:19.589291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7fe181fd-89e9-494e-8b53-7f234502d61c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:19.589937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7fe181fd-89e9-494e-8b53-7f234502d61c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:19.596216 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fe181fd-89e9-494e-8b53-7f234502d61c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:19.596664 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fe181fd-89e9-494e-8b53-7f234502d61c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:19.597431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fe181fd-89e9-494e-8b53-7f234502d61c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:19.597867 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fe181fd-89e9-494e-8b53-7f234502d61c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:19.667887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fe181fd-89e9-494e-8b53-7f234502d61c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:19.681078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7fe181fd-89e9-494e-8b53-7f234502d61c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.096307 May 26 13:26:19.681717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 881/1789] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:19 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:20.699269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6e93a58-2c17-4420-b772-72b02973a99b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:20.699884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6e93a58-2c17-4420-b772-72b02973a99b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:20.706633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6e93a58-2c17-4420-b772-72b02973a99b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:20.707095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6e93a58-2c17-4420-b772-72b02973a99b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:20.707868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6e93a58-2c17-4420-b772-72b02973a99b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:20.708299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6e93a58-2c17-4420-b772-72b02973a99b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:20.822559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6e93a58-2c17-4420-b772-72b02973a99b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:20.830650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6e93a58-2c17-4420-b772-72b02973a99b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.135286 May 26 13:26:20.831228 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 909/1790] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:20 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:21.848857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ea54ca62-21d4-4c00-bbe8-ff13ed5fea0c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:21.849492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ea54ca62-21d4-4c00-bbe8-ff13ed5fea0c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:21.857144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea54ca62-21d4-4c00-bbe8-ff13ed5fea0c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:21.857592 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea54ca62-21d4-4c00-bbe8-ff13ed5fea0c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:21.858358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea54ca62-21d4-4c00-bbe8-ff13ed5fea0c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:21.858817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea54ca62-21d4-4c00-bbe8-ff13ed5fea0c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:21.970268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea54ca62-21d4-4c00-bbe8-ff13ed5fea0c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:21.979271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ea54ca62-21d4-4c00-bbe8-ff13ed5fea0c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.134392 May 26 13:26:21.979833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 882/1791] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:21 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:22.996756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c05a5110-b902-4fa1-a88f-db55826e0f48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:22.997397 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c05a5110-b902-4fa1-a88f-db55826e0f48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:23.003526 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c05a5110-b902-4fa1-a88f-db55826e0f48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:23.003979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c05a5110-b902-4fa1-a88f-db55826e0f48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:23.004755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c05a5110-b902-4fa1-a88f-db55826e0f48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:23.005187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c05a5110-b902-4fa1-a88f-db55826e0f48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:23.073305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c05a5110-b902-4fa1-a88f-db55826e0f48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:23.081797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c05a5110-b902-4fa1-a88f-db55826e0f48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.088891 May 26 13:26:23.082290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 910/1792] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:22 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:24.101771 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4fc2e338-66b0-4a77-a993-56038b58fa5a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:24.103057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4fc2e338-66b0-4a77-a993-56038b58fa5a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:24.110552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fc2e338-66b0-4a77-a993-56038b58fa5a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:24.111011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fc2e338-66b0-4a77-a993-56038b58fa5a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:24.111784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fc2e338-66b0-4a77-a993-56038b58fa5a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:24.112226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fc2e338-66b0-4a77-a993-56038b58fa5a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:24.174907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4fc2e338-66b0-4a77-a993-56038b58fa5a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:24.183001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4fc2e338-66b0-4a77-a993-56038b58fa5a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087634 May 26 13:26:24.183560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 883/1793] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:24 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:25.200817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a077592-f915-46a5-976e-7ea5be669da9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:25.201445 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a077592-f915-46a5-976e-7ea5be669da9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:25.207901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a077592-f915-46a5-976e-7ea5be669da9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:25.208348 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a077592-f915-46a5-976e-7ea5be669da9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:25.209105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a077592-f915-46a5-976e-7ea5be669da9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:25.209538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a077592-f915-46a5-976e-7ea5be669da9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:25.271343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a077592-f915-46a5-976e-7ea5be669da9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:25.280114 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a077592-f915-46a5-976e-7ea5be669da9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083177 May 26 13:26:25.280689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 911/1794] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:25 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:26:26.297216 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77c58dee-8c22-49eb-b0a3-e4fec71fa055 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:26.297978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-77c58dee-8c22-49eb-b0a3-e4fec71fa055 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:26.305057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77c58dee-8c22-49eb-b0a3-e4fec71fa055 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:26.305542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77c58dee-8c22-49eb-b0a3-e4fec71fa055 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:26.306376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77c58dee-8c22-49eb-b0a3-e4fec71fa055 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:26.306858 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77c58dee-8c22-49eb-b0a3-e4fec71fa055 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:26.370097 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-77c58dee-8c22-49eb-b0a3-e4fec71fa055 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:26.378808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77c58dee-8c22-49eb-b0a3-e4fec71fa055 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085397 May 26 13:26:26.379385 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 884/1795] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:26 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:27.395093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7c363078-550e-4e28-822b-d85f68835909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:27.395714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7c363078-550e-4e28-822b-d85f68835909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:27.398087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:27.402910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c363078-550e-4e28-822b-d85f68835909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:27.403368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c363078-550e-4e28-822b-d85f68835909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:27.404146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c363078-550e-4e28-822b-d85f68835909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:27.404588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c363078-550e-4e28-822b-d85f68835909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:27.407370 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:27.469140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c363078-550e-4e28-822b-d85f68835909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:27.478203 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7c363078-550e-4e28-822b-d85f68835909 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086901 May 26 13:26:27.478820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 912/1796] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:27 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:28.496285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4d5e910-13ff-4085-accf-13a314c63ea9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:28.496899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a4d5e910-13ff-4085-accf-13a314c63ea9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:28.499256 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:28.504006 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4d5e910-13ff-4085-accf-13a314c63ea9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:28.504457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4d5e910-13ff-4085-accf-13a314c63ea9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:28.505220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4d5e910-13ff-4085-accf-13a314c63ea9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:28.505660 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4d5e910-13ff-4085-accf-13a314c63ea9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:28.568523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a4d5e910-13ff-4085-accf-13a314c63ea9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:28.577601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4d5e910-13ff-4085-accf-13a314c63ea9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085463 May 26 13:26:28.578185 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 885/1797] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:28 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:29.594305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b0a8a36-fde5-4a29-b2a9-1193b458a2ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:29.594880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b0a8a36-fde5-4a29-b2a9-1193b458a2ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:29.601313 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0a8a36-fde5-4a29-b2a9-1193b458a2ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:29.601760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0a8a36-fde5-4a29-b2a9-1193b458a2ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:29.602831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0a8a36-fde5-4a29-b2a9-1193b458a2ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:29.603267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0a8a36-fde5-4a29-b2a9-1193b458a2ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:29.664249 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b0a8a36-fde5-4a29-b2a9-1193b458a2ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:29.672366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b0a8a36-fde5-4a29-b2a9-1193b458a2ea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.081863 May 26 13:26:29.672927 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 913/1798] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:29 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:30.689837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-880597dd-0588-4658-9762-2486077816e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:30.690456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-880597dd-0588-4658-9762-2486077816e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:30.697464 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-880597dd-0588-4658-9762-2486077816e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:30.697921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-880597dd-0588-4658-9762-2486077816e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:30.698784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-880597dd-0588-4658-9762-2486077816e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:30.699229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-880597dd-0588-4658-9762-2486077816e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:30.701743 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:30.763548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-880597dd-0588-4658-9762-2486077816e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:30.771351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-880597dd-0588-4658-9762-2486077816e9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085401 May 26 13:26:30.771919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 886/1799] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:30 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:31.789777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-938b530e-3a7c-47a4-a2c2-2603c46f5991 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:31.790401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-938b530e-3a7c-47a4-a2c2-2603c46f5991 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:31.797429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-938b530e-3a7c-47a4-a2c2-2603c46f5991 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:31.797875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-938b530e-3a7c-47a4-a2c2-2603c46f5991 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:31.798675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-938b530e-3a7c-47a4-a2c2-2603c46f5991 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:31.799112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-938b530e-3a7c-47a4-a2c2-2603c46f5991 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:31.871806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-938b530e-3a7c-47a4-a2c2-2603c46f5991 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:31.879854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-938b530e-3a7c-47a4-a2c2-2603c46f5991 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.094881 May 26 13:26:31.880416 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 914/1800] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:31 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:32.897595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2fafc46d-84d7-48cb-a87c-0259a3b4d47d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:32.898954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2fafc46d-84d7-48cb-a87c-0259a3b4d47d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:32.905474 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fafc46d-84d7-48cb-a87c-0259a3b4d47d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:32.905937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fafc46d-84d7-48cb-a87c-0259a3b4d47d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:32.906751 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fafc46d-84d7-48cb-a87c-0259a3b4d47d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:32.907229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fafc46d-84d7-48cb-a87c-0259a3b4d47d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:32.970163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2fafc46d-84d7-48cb-a87c-0259a3b4d47d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:32.979527 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2fafc46d-84d7-48cb-a87c-0259a3b4d47d tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085869 May 26 13:26:32.980099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 887/1801] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:32 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:33.282477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:26:33.282659 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:26:33.997835 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d46e76a7-473d-4daf-b9b3-35981837db64 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:33.998487 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d46e76a7-473d-4daf-b9b3-35981837db64 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:34.004889 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d46e76a7-473d-4daf-b9b3-35981837db64 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:34.005333 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d46e76a7-473d-4daf-b9b3-35981837db64 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:34.006089 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d46e76a7-473d-4daf-b9b3-35981837db64 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:34.006538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d46e76a7-473d-4daf-b9b3-35981837db64 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:34.067717 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d46e76a7-473d-4daf-b9b3-35981837db64 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:34.075734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d46e76a7-473d-4daf-b9b3-35981837db64 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.081760 May 26 13:26:34.076296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 915/1802] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:33 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:26:35.092991 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5aa68469-d35e-4e50-b18c-923e7f261f0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:35.093603 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5aa68469-d35e-4e50-b18c-923e7f261f0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:35.100225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aa68469-d35e-4e50-b18c-923e7f261f0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:35.100672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aa68469-d35e-4e50-b18c-923e7f261f0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:35.102044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aa68469-d35e-4e50-b18c-923e7f261f0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:35.102795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aa68469-d35e-4e50-b18c-923e7f261f0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:35.164383 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5aa68469-d35e-4e50-b18c-923e7f261f0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:35.172304 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5aa68469-d35e-4e50-b18c-923e7f261f0a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083156 May 26 13:26:35.172863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 888/1803] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:35 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:36.189270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f63d627f-2a3a-48b5-8136-f7cb3603cfd9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:36.189836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f63d627f-2a3a-48b5-8136-f7cb3603cfd9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:36.197130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63d627f-2a3a-48b5-8136-f7cb3603cfd9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:36.197581 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63d627f-2a3a-48b5-8136-f7cb3603cfd9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:36.198360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63d627f-2a3a-48b5-8136-f7cb3603cfd9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:36.198845 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63d627f-2a3a-48b5-8136-f7cb3603cfd9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:36.260985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f63d627f-2a3a-48b5-8136-f7cb3603cfd9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:36.269042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f63d627f-2a3a-48b5-8136-f7cb3603cfd9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083775 May 26 13:26:36.269616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 916/1804] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:36 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:37.286724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e1b1484-0b83-4f13-a27e-09a2e48cf7ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:37.287335 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e1b1484-0b83-4f13-a27e-09a2e48cf7ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:37.294285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e1b1484-0b83-4f13-a27e-09a2e48cf7ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:37.294941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e1b1484-0b83-4f13-a27e-09a2e48cf7ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:37.295713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e1b1484-0b83-4f13-a27e-09a2e48cf7ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:37.296149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e1b1484-0b83-4f13-a27e-09a2e48cf7ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:37.359102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e1b1484-0b83-4f13-a27e-09a2e48cf7ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:37.366934 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e1b1484-0b83-4f13-a27e-09a2e48cf7ff tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084301 May 26 13:26:37.367495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 889/1805] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:37 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:38.384462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a0507a5-e836-4fc1-af1c-4a6b967da775 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:38.385113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a0507a5-e836-4fc1-af1c-4a6b967da775 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:38.391803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0507a5-e836-4fc1-af1c-4a6b967da775 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:38.392257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0507a5-e836-4fc1-af1c-4a6b967da775 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:38.393035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0507a5-e836-4fc1-af1c-4a6b967da775 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:38.393475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0507a5-e836-4fc1-af1c-4a6b967da775 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:38.453967 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a0507a5-e836-4fc1-af1c-4a6b967da775 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:38.462601 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a0507a5-e836-4fc1-af1c-4a6b967da775 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.082326 May 26 13:26:38.463253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 917/1806] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:38 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:39.480161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ed6359d-fe00-4a9a-bc55-1d0c47bed28c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:39.480796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ed6359d-fe00-4a9a-bc55-1d0c47bed28c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:39.487379 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ed6359d-fe00-4a9a-bc55-1d0c47bed28c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:39.487827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ed6359d-fe00-4a9a-bc55-1d0c47bed28c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:39.488596 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ed6359d-fe00-4a9a-bc55-1d0c47bed28c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:39.489029 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ed6359d-fe00-4a9a-bc55-1d0c47bed28c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:39.552472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ed6359d-fe00-4a9a-bc55-1d0c47bed28c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:39.561537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ed6359d-fe00-4a9a-bc55-1d0c47bed28c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086163 May 26 13:26:39.562153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 890/1807] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:39 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:40.578712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ddb97f08-b95e-48ee-a693-ba6c8005ce96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:40.579248 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ddb97f08-b95e-48ee-a693-ba6c8005ce96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:40.587046 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddb97f08-b95e-48ee-a693-ba6c8005ce96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:40.587499 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddb97f08-b95e-48ee-a693-ba6c8005ce96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:40.588267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddb97f08-b95e-48ee-a693-ba6c8005ce96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:40.588708 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddb97f08-b95e-48ee-a693-ba6c8005ce96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:40.655575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ddb97f08-b95e-48ee-a693-ba6c8005ce96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:40.666509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ddb97f08-b95e-48ee-a693-ba6c8005ce96 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.091688 May 26 13:26:40.667171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 918/1808] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:40 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:41.684472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-414583c8-00f6-4764-a703-f1d6f5b18c48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:41.685086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-414583c8-00f6-4764-a703-f1d6f5b18c48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:41.692198 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-414583c8-00f6-4764-a703-f1d6f5b18c48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:41.692677 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-414583c8-00f6-4764-a703-f1d6f5b18c48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:41.693448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-414583c8-00f6-4764-a703-f1d6f5b18c48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:41.693871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-414583c8-00f6-4764-a703-f1d6f5b18c48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:41.758507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-414583c8-00f6-4764-a703-f1d6f5b18c48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:41.767586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-414583c8-00f6-4764-a703-f1d6f5b18c48 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087063 May 26 13:26:41.768176 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 891/1809] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:41 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:42.785782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f3e9e1e-369a-4636-8c90-ae0231c82886 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:42.786393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f3e9e1e-369a-4636-8c90-ae0231c82886 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:42.794259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f3e9e1e-369a-4636-8c90-ae0231c82886 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:42.794756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f3e9e1e-369a-4636-8c90-ae0231c82886 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:42.795555 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f3e9e1e-369a-4636-8c90-ae0231c82886 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:42.796115 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f3e9e1e-369a-4636-8c90-ae0231c82886 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:42.862603 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f3e9e1e-369a-4636-8c90-ae0231c82886 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:42.871962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f3e9e1e-369a-4636-8c90-ae0231c82886 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.090431 May 26 13:26:42.872542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 919/1810] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:42 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:43.889395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-18306618-1d66-4d4d-81c0-265b86394cd1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:43.890013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-18306618-1d66-4d4d-81c0-265b86394cd1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:43.896509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18306618-1d66-4d4d-81c0-265b86394cd1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:43.896963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18306618-1d66-4d4d-81c0-265b86394cd1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:43.897732 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18306618-1d66-4d4d-81c0-265b86394cd1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:43.898172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18306618-1d66-4d4d-81c0-265b86394cd1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:43.958625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-18306618-1d66-4d4d-81c0-265b86394cd1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:43.966612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-18306618-1d66-4d4d-81c0-265b86394cd1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.081099 May 26 13:26:43.967178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 892/1811] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:43 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:44.984033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45ac643a-c00e-4e99-bb3b-1197604da007 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:44.984669 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45ac643a-c00e-4e99-bb3b-1197604da007 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:44.991215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ac643a-c00e-4e99-bb3b-1197604da007 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:44.991668 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ac643a-c00e-4e99-bb3b-1197604da007 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:44.992472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ac643a-c00e-4e99-bb3b-1197604da007 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:44.992933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ac643a-c00e-4e99-bb3b-1197604da007 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:45.053094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45ac643a-c00e-4e99-bb3b-1197604da007 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:45.061263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45ac643a-c00e-4e99-bb3b-1197604da007 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.081078 May 26 13:26:45.061834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 920/1812] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:44 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:46.083083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eaf6810d-b851-4ca7-89ca-8fce4c57d2bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:46.083729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eaf6810d-b851-4ca7-89ca-8fce4c57d2bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:46.091460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaf6810d-b851-4ca7-89ca-8fce4c57d2bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:46.091923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaf6810d-b851-4ca7-89ca-8fce4c57d2bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:46.092729 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaf6810d-b851-4ca7-89ca-8fce4c57d2bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:46.093161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaf6810d-b851-4ca7-89ca-8fce4c57d2bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:46.169319 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eaf6810d-b851-4ca7-89ca-8fce4c57d2bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:46.179842 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eaf6810d-b851-4ca7-89ca-8fce4c57d2bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.104134 May 26 13:26:46.180835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 893/1813] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:46 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:47.197349 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f692414c-5bf8-4f10-a67a-40a97b67dabb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:47.198087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f692414c-5bf8-4f10-a67a-40a97b67dabb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:47.204272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f692414c-5bf8-4f10-a67a-40a97b67dabb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:47.204730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f692414c-5bf8-4f10-a67a-40a97b67dabb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:47.205524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f692414c-5bf8-4f10-a67a-40a97b67dabb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:47.205956 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f692414c-5bf8-4f10-a67a-40a97b67dabb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:47.271691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f692414c-5bf8-4f10-a67a-40a97b67dabb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:47.280267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f692414c-5bf8-4f10-a67a-40a97b67dabb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087297 May 26 13:26:47.280954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 921/1814] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:47 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:48.297911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7a6b97f-f0d3-496f-8ba0-a5f6dd8b8c37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:48.298602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7a6b97f-f0d3-496f-8ba0-a5f6dd8b8c37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:48.305545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7a6b97f-f0d3-496f-8ba0-a5f6dd8b8c37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:48.307443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7a6b97f-f0d3-496f-8ba0-a5f6dd8b8c37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:48.307443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7a6b97f-f0d3-496f-8ba0-a5f6dd8b8c37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:48.307443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7a6b97f-f0d3-496f-8ba0-a5f6dd8b8c37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:48.377453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7a6b97f-f0d3-496f-8ba0-a5f6dd8b8c37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:48.387662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7a6b97f-f0d3-496f-8ba0-a5f6dd8b8c37 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.093512 May 26 13:26:48.391381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 894/1815] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:48 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:49.408805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b89ea73-c72f-405f-9f28-eb78c4eee7d6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:49.409745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b89ea73-c72f-405f-9f28-eb78c4eee7d6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:49.420569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b89ea73-c72f-405f-9f28-eb78c4eee7d6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:49.421367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b89ea73-c72f-405f-9f28-eb78c4eee7d6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:49.422405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b89ea73-c72f-405f-9f28-eb78c4eee7d6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:49.422869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b89ea73-c72f-405f-9f28-eb78c4eee7d6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:49.498781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b89ea73-c72f-405f-9f28-eb78c4eee7d6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:49.506852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b89ea73-c72f-405f-9f28-eb78c4eee7d6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.104475 May 26 13:26:49.507432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 922/1816] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:49 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:50.525591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57dd70d4-d9b5-4526-b32f-f08581cfb561 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:50.526267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57dd70d4-d9b5-4526-b32f-f08581cfb561 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:50.532530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57dd70d4-d9b5-4526-b32f-f08581cfb561 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:50.532947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57dd70d4-d9b5-4526-b32f-f08581cfb561 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:50.533711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57dd70d4-d9b5-4526-b32f-f08581cfb561 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:50.534143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57dd70d4-d9b5-4526-b32f-f08581cfb561 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:50.599172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57dd70d4-d9b5-4526-b32f-f08581cfb561 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:50.607927 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57dd70d4-d9b5-4526-b32f-f08581cfb561 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086922 May 26 13:26:50.608490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 895/1817] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:50 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:51.625123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a8c0902-52f8-47f7-a9a9-e58d9a79bb7b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:51.625854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a8c0902-52f8-47f7-a9a9-e58d9a79bb7b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:51.632336 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a8c0902-52f8-47f7-a9a9-e58d9a79bb7b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:51.632787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a8c0902-52f8-47f7-a9a9-e58d9a79bb7b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:51.634384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a8c0902-52f8-47f7-a9a9-e58d9a79bb7b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:51.634852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a8c0902-52f8-47f7-a9a9-e58d9a79bb7b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:51.694386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a8c0902-52f8-47f7-a9a9-e58d9a79bb7b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:51.702897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a8c0902-52f8-47f7-a9a9-e58d9a79bb7b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.081636 May 26 13:26:51.703476 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 923/1818] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:51 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:52.721987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbd6f645-bb5c-456b-a581-2b543026caf7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:52.722619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbd6f645-bb5c-456b-a581-2b543026caf7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:52.729648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbd6f645-bb5c-456b-a581-2b543026caf7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:52.730093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbd6f645-bb5c-456b-a581-2b543026caf7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:52.730892 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbd6f645-bb5c-456b-a581-2b543026caf7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:52.731329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbd6f645-bb5c-456b-a581-2b543026caf7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:52.793560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbd6f645-bb5c-456b-a581-2b543026caf7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:52.801636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbd6f645-bb5c-456b-a581-2b543026caf7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083570 May 26 13:26:52.802211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 896/1819] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:52 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:53.819527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-179d8c76-7e88-45b5-94df-35ebdfcb655b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:53.820123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-179d8c76-7e88-45b5-94df-35ebdfcb655b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:53.827813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179d8c76-7e88-45b5-94df-35ebdfcb655b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:53.828270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179d8c76-7e88-45b5-94df-35ebdfcb655b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:53.829045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179d8c76-7e88-45b5-94df-35ebdfcb655b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:53.829488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179d8c76-7e88-45b5-94df-35ebdfcb655b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:53.891974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-179d8c76-7e88-45b5-94df-35ebdfcb655b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:53.900300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-179d8c76-7e88-45b5-94df-35ebdfcb655b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084707 May 26 13:26:53.900932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 924/1820] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:53 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:54.917914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-11a2b90f-12fe-4ba2-8592-be7975e4cd24 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:54.918551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-11a2b90f-12fe-4ba2-8592-be7975e4cd24 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:54.925062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11a2b90f-12fe-4ba2-8592-be7975e4cd24 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:54.925520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11a2b90f-12fe-4ba2-8592-be7975e4cd24 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:54.926298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11a2b90f-12fe-4ba2-8592-be7975e4cd24 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:54.926782 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11a2b90f-12fe-4ba2-8592-be7975e4cd24 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:54.987636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-11a2b90f-12fe-4ba2-8592-be7975e4cd24 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:54.995678 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-11a2b90f-12fe-4ba2-8592-be7975e4cd24 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.081958 May 26 13:26:54.996238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 897/1821] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:54 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:56.013307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fc2e56c8-7ebb-408c-81a4-afb742665715 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:56.013917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fc2e56c8-7ebb-408c-81a4-afb742665715 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:56.020418 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc2e56c8-7ebb-408c-81a4-afb742665715 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:56.020868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc2e56c8-7ebb-408c-81a4-afb742665715 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:56.021623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc2e56c8-7ebb-408c-81a4-afb742665715 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:56.022059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc2e56c8-7ebb-408c-81a4-afb742665715 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:56.085362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fc2e56c8-7ebb-408c-81a4-afb742665715 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:56.093479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fc2e56c8-7ebb-408c-81a4-afb742665715 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084020 May 26 13:26:56.094056 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 925/1822] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:56 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:57.110857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d6bb724-5a17-48ba-b328-a5f20d0bcc9b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:57.111409 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d6bb724-5a17-48ba-b328-a5f20d0bcc9b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:57.118849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d6bb724-5a17-48ba-b328-a5f20d0bcc9b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:57.119331 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d6bb724-5a17-48ba-b328-a5f20d0bcc9b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:57.120112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d6bb724-5a17-48ba-b328-a5f20d0bcc9b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:57.120556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d6bb724-5a17-48ba-b328-a5f20d0bcc9b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:57.184397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d6bb724-5a17-48ba-b328-a5f20d0bcc9b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:57.192446 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d6bb724-5a17-48ba-b328-a5f20d0bcc9b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085604 May 26 13:26:57.193037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 898/1823] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:57 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:58.209085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12417f2b-07e1-4153-bb15-de8478c7d49c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:58.209726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12417f2b-07e1-4153-bb15-de8478c7d49c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:58.212068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:58.216970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12417f2b-07e1-4153-bb15-de8478c7d49c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:58.217408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12417f2b-07e1-4153-bb15-de8478c7d49c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:58.218307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12417f2b-07e1-4153-bb15-de8478c7d49c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:58.218628 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12417f2b-07e1-4153-bb15-de8478c7d49c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:58.221325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:58.285918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12417f2b-07e1-4153-bb15-de8478c7d49c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:58.296168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12417f2b-07e1-4153-bb15-de8478c7d49c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.088881 May 26 13:26:58.296168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 926/1824] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:58 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:26:59.311633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49ce62a9-3219-4620-b23c-5b169b4d0a9f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:26:59.312285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49ce62a9-3219-4620-b23c-5b169b4d0a9f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:26:59.314791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:59.319551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49ce62a9-3219-4620-b23c-5b169b4d0a9f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:59.320008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49ce62a9-3219-4620-b23c-5b169b4d0a9f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:59.321220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49ce62a9-3219-4620-b23c-5b169b4d0a9f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:26:59.321546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49ce62a9-3219-4620-b23c-5b169b4d0a9f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:26:59.383643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49ce62a9-3219-4620-b23c-5b169b4d0a9f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:26:59.391601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49ce62a9-3219-4620-b23c-5b169b4d0a9f tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.083833 May 26 13:26:59.398499 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 899/1825] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:26:59 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:00.408078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39a89079-ce4f-4ab2-bb8d-babab95c6d5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:00.408706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39a89079-ce4f-4ab2-bb8d-babab95c6d5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:00.416016 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39a89079-ce4f-4ab2-bb8d-babab95c6d5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:00.416471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39a89079-ce4f-4ab2-bb8d-babab95c6d5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:00.417246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39a89079-ce4f-4ab2-bb8d-babab95c6d5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:00.417690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39a89079-ce4f-4ab2-bb8d-babab95c6d5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:00.480137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39a89079-ce4f-4ab2-bb8d-babab95c6d5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:00.488421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39a89079-ce4f-4ab2-bb8d-babab95c6d5c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084310 May 26 13:27:00.488989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 927/1826] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:00 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:01.506774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-18bdd2ce-7500-4a3b-b512-743ea7e65385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:01.507392 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-18bdd2ce-7500-4a3b-b512-743ea7e65385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:01.514553 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18bdd2ce-7500-4a3b-b512-743ea7e65385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:01.515043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18bdd2ce-7500-4a3b-b512-743ea7e65385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:01.515793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18bdd2ce-7500-4a3b-b512-743ea7e65385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:01.516238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18bdd2ce-7500-4a3b-b512-743ea7e65385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:01.518856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:27:01.581868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-18bdd2ce-7500-4a3b-b512-743ea7e65385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:01.590507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-18bdd2ce-7500-4a3b-b512-743ea7e65385 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087739 May 26 13:27:01.591080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 900/1827] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:01 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:02.608730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e955b76-719a-48ec-868c-e4a08a9f46f1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:02.609326 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e955b76-719a-48ec-868c-e4a08a9f46f1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:02.615813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e955b76-719a-48ec-868c-e4a08a9f46f1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:02.616264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e955b76-719a-48ec-868c-e4a08a9f46f1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:02.617021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e955b76-719a-48ec-868c-e4a08a9f46f1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:02.617454 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e955b76-719a-48ec-868c-e4a08a9f46f1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:02.685701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e955b76-719a-48ec-868c-e4a08a9f46f1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:02.693709 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e955b76-719a-48ec-868c-e4a08a9f46f1 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.089084 May 26 13:27:02.694277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 928/1828] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:02 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:03.711085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-76c42e3d-e453-48b9-acd8-bf9a38a0aa2b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:03.711709 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-76c42e3d-e453-48b9-acd8-bf9a38a0aa2b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:03.719098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76c42e3d-e453-48b9-acd8-bf9a38a0aa2b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:03.719552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76c42e3d-e453-48b9-acd8-bf9a38a0aa2b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:03.720326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76c42e3d-e453-48b9-acd8-bf9a38a0aa2b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:03.720762 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76c42e3d-e453-48b9-acd8-bf9a38a0aa2b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:03.781540 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-76c42e3d-e453-48b9-acd8-bf9a38a0aa2b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:03.789553 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-76c42e3d-e453-48b9-acd8-bf9a38a0aa2b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.082459 May 26 13:27:03.790218 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 901/1829] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:03 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:04.806925 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9329b1e3-116d-4aa5-9899-eed70c23721a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:04.807523 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9329b1e3-116d-4aa5-9899-eed70c23721a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:04.814113 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9329b1e3-116d-4aa5-9899-eed70c23721a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:04.814591 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9329b1e3-116d-4aa5-9899-eed70c23721a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:04.815350 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9329b1e3-116d-4aa5-9899-eed70c23721a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:04.815793 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9329b1e3-116d-4aa5-9899-eed70c23721a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:04.880325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9329b1e3-116d-4aa5-9899-eed70c23721a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:04.894692 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9329b1e3-116d-4aa5-9899-eed70c23721a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.091587 May 26 13:27:04.895271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 929/1830] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:04 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:05.913449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75deab9e-7c48-498e-930f-0e223bf549a4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:05.914055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75deab9e-7c48-498e-930f-0e223bf549a4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:05.920620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75deab9e-7c48-498e-930f-0e223bf549a4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:05.921068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75deab9e-7c48-498e-930f-0e223bf549a4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:05.921827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75deab9e-7c48-498e-930f-0e223bf549a4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:05.922263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75deab9e-7c48-498e-930f-0e223bf549a4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:05.985948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75deab9e-7c48-498e-930f-0e223bf549a4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:05.993967 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75deab9e-7c48-498e-930f-0e223bf549a4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084445 May 26 13:27:05.994552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 902/1831] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:05 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:07.011620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-447160c6-4137-4f14-b529-7bd29a2401b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:07.012232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-447160c6-4137-4f14-b529-7bd29a2401b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:07.018980 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-447160c6-4137-4f14-b529-7bd29a2401b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:07.019433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-447160c6-4137-4f14-b529-7bd29a2401b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:07.020197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-447160c6-4137-4f14-b529-7bd29a2401b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:07.020630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-447160c6-4137-4f14-b529-7bd29a2401b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:07.089299 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-447160c6-4137-4f14-b529-7bd29a2401b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:07.098958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-447160c6-4137-4f14-b529-7bd29a2401b9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.091603 May 26 13:27:07.099537 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 930/1832] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:07 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:08.117041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e0b1198-681d-4a97-88a3-dcd8c100997c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:08.117581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e0b1198-681d-4a97-88a3-dcd8c100997c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:08.127169 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e0b1198-681d-4a97-88a3-dcd8c100997c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:08.127658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e0b1198-681d-4a97-88a3-dcd8c100997c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:08.128581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e0b1198-681d-4a97-88a3-dcd8c100997c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:08.129370 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e0b1198-681d-4a97-88a3-dcd8c100997c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:08.195323 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1e0b1198-681d-4a97-88a3-dcd8c100997c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:08.203575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e0b1198-681d-4a97-88a3-dcd8c100997c tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.090480 May 26 13:27:08.204139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 903/1833] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:08 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:09.220881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bbc0a32c-4f39-4eb5-9e1c-0ce223fb110b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:09.221483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bbc0a32c-4f39-4eb5-9e1c-0ce223fb110b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:09.228557 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbc0a32c-4f39-4eb5-9e1c-0ce223fb110b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:09.228930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbc0a32c-4f39-4eb5-9e1c-0ce223fb110b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:09.229849 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbc0a32c-4f39-4eb5-9e1c-0ce223fb110b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:09.230289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbc0a32c-4f39-4eb5-9e1c-0ce223fb110b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:09.293808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bbc0a32c-4f39-4eb5-9e1c-0ce223fb110b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:09.303074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bbc0a32c-4f39-4eb5-9e1c-0ce223fb110b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.086034 May 26 13:27:09.303673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 931/1834] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:09 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:10.320800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b361bdeb-aaae-46c9-9ccb-bb3379f8f5f9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:10.321402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b361bdeb-aaae-46c9-9ccb-bb3379f8f5f9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:10.328233 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b361bdeb-aaae-46c9-9ccb-bb3379f8f5f9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:10.328697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b361bdeb-aaae-46c9-9ccb-bb3379f8f5f9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:10.329458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b361bdeb-aaae-46c9-9ccb-bb3379f8f5f9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:10.329891 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b361bdeb-aaae-46c9-9ccb-bb3379f8f5f9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:10.393957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b361bdeb-aaae-46c9-9ccb-bb3379f8f5f9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:10.402703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b361bdeb-aaae-46c9-9ccb-bb3379f8f5f9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085670 May 26 13:27:10.403278 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 904/1835] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:10 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:11.420811 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7061d956-fc6a-4907-ab01-bc24db27d9dc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:11.421409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7061d956-fc6a-4907-ab01-bc24db27d9dc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:11.428026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7061d956-fc6a-4907-ab01-bc24db27d9dc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:11.428518 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7061d956-fc6a-4907-ab01-bc24db27d9dc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:11.429339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7061d956-fc6a-4907-ab01-bc24db27d9dc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:11.429778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7061d956-fc6a-4907-ab01-bc24db27d9dc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:11.495606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7061d956-fc6a-4907-ab01-bc24db27d9dc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:11.503645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7061d956-fc6a-4907-ab01-bc24db27d9dc tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087578 May 26 13:27:11.504220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 932/1836] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:11 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:12.521135 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64adf644-c32a-419f-9c28-53103dd333c9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:12.521736 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64adf644-c32a-419f-9c28-53103dd333c9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:12.528339 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64adf644-c32a-419f-9c28-53103dd333c9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:12.528792 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64adf644-c32a-419f-9c28-53103dd333c9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:12.529554 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64adf644-c32a-419f-9c28-53103dd333c9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:12.529994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64adf644-c32a-419f-9c28-53103dd333c9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:12.594456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64adf644-c32a-419f-9c28-53103dd333c9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:12.603386 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64adf644-c32a-419f-9c28-53103dd333c9 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085308 May 26 13:27:12.603672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 905/1837] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:12 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:13.620861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f0860d8-48b2-4549-bf84-09bcc8dd3088 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:13.621478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f0860d8-48b2-4549-bf84-09bcc8dd3088 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:13.628184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f0860d8-48b2-4549-bf84-09bcc8dd3088 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:13.628625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f0860d8-48b2-4549-bf84-09bcc8dd3088 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:13.629408 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f0860d8-48b2-4549-bf84-09bcc8dd3088 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:13.630362 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f0860d8-48b2-4549-bf84-09bcc8dd3088 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:13.693151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f0860d8-48b2-4549-bf84-09bcc8dd3088 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:13.701688 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f0860d8-48b2-4549-bf84-09bcc8dd3088 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.085102 May 26 13:27:13.702265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 933/1838] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:13 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:14.718711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57c7d484-1d57-4218-99c5-9e3d43e36ed6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:14.719321 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57c7d484-1d57-4218-99c5-9e3d43e36ed6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:14.725837 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57c7d484-1d57-4218-99c5-9e3d43e36ed6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:14.726284 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57c7d484-1d57-4218-99c5-9e3d43e36ed6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:14.727086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57c7d484-1d57-4218-99c5-9e3d43e36ed6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:14.727780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57c7d484-1d57-4218-99c5-9e3d43e36ed6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:14.794093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57c7d484-1d57-4218-99c5-9e3d43e36ed6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:14.802054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57c7d484-1d57-4218-99c5-9e3d43e36ed6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.087908 May 26 13:27:14.802639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 906/1839] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:14 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:15.818678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-67d5d908-48ad-4270-914c-1ea2a079dd5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:15.832140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-67d5d908-48ad-4270-914c-1ea2a079dd5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:15.832140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67d5d908-48ad-4270-914c-1ea2a079dd5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:15.832140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67d5d908-48ad-4270-914c-1ea2a079dd5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:15.832140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67d5d908-48ad-4270-914c-1ea2a079dd5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:15.832580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67d5d908-48ad-4270-914c-1ea2a079dd5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:15.894755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-67d5d908-48ad-4270-914c-1ea2a079dd5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:15.903145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-67d5d908-48ad-4270-914c-1ea2a079dd5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.088160 May 26 13:27:15.903381 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 934/1840] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:15 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:16.920133 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-00b99fd7-b209-4387-8dec-08795d8a62ac tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:16.920784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-00b99fd7-b209-4387-8dec-08795d8a62ac tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:16.927697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00b99fd7-b209-4387-8dec-08795d8a62ac tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:16.928159 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00b99fd7-b209-4387-8dec-08795d8a62ac tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:16.928958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00b99fd7-b209-4387-8dec-08795d8a62ac tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:16.929409 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00b99fd7-b209-4387-8dec-08795d8a62ac tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:16.996700 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-00b99fd7-b209-4387-8dec-08795d8a62ac tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:17.004899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-00b99fd7-b209-4387-8dec-08795d8a62ac tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.088732 May 26 13:27:17.005477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 907/1841] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:16 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:17.640598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a6047ebd-12da-4fab-83ff-8f54fc57622b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:17.641103 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a6047ebd-12da-4fab-83ff-8f54fc57622b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:17.645936 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-5ab394fd-441e-4cb0-a890-63430869874d req-495d5669-f536-4647-a6c2-2b24e4af6c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d4069d-fe62-4f1e-b4ad-ed907dbf2b99", "tag": "bd3badd8-5652-406f-8c25-159b3d8554a1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:27:17.648048 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6047ebd-12da-4fab-83ff-8f54fc57622b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:17.648496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6047ebd-12da-4fab-83ff-8f54fc57622b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:17.649511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6047ebd-12da-4fab-83ff-8f54fc57622b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:17.650177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6047ebd-12da-4fab-83ff-8f54fc57622b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:17.657017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5ab394fd-441e-4cb0-a890-63430869874d req-495d5669-f536-4647-a6c2-2b24e4af6c7b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:17.657813 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5ab394fd-441e-4cb0-a890-63430869874d req-495d5669-f536-4647-a6c2-2b24e4af6c7b service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:17.670733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-5ab394fd-441e-4cb0-a890-63430869874d req-495d5669-f536-4647-a6c2-2b24e4af6c7b service nova] Creating event network-changed:bd3badd8-5652-406f-8c25-159b3d8554a1 for instance 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 on hv-cinder-81514 May 26 13:27:17.678952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-5ab394fd-441e-4cb0-a890-63430869874d req-495d5669-f536-4647-a6c2-2b24e4af6c7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037368 May 26 13:27:17.680594 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 908/1842] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:27:17.686824 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a6047ebd-12da-4fab-83ff-8f54fc57622b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:27:18.023456 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1365a34a-4c34-4808-86d6-776728f25878 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:18.026831 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1365a34a-4c34-4808-86d6-776728f25878 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:18.031520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1365a34a-4c34-4808-86d6-776728f25878 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:18.032435 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1365a34a-4c34-4808-86d6-776728f25878 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:18.033414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1365a34a-4c34-4808-86d6-776728f25878 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:18.033941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1365a34a-4c34-4808-86d6-776728f25878 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:18.047005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a6047ebd-12da-4fab-83ff-8f54fc57622b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 204 len: 0 microversion: 2.1 time: 0.410631 May 26 13:27:18.050765 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 935/1843] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:27:17 2022] DELETE /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:27:18.056285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5c98a91f-47bd-4d2e-9cab-417a4bf70f5a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:18.057097 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5c98a91f-47bd-4d2e-9cab-417a4bf70f5a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:18.070920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c98a91f-47bd-4d2e-9cab-417a4bf70f5a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:18.071381 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c98a91f-47bd-4d2e-9cab-417a4bf70f5a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:18.072472 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c98a91f-47bd-4d2e-9cab-417a4bf70f5a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:18.072896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c98a91f-47bd-4d2e-9cab-417a4bf70f5a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:18.135148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1365a34a-4c34-4808-86d6-776728f25878 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:18.144068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1365a34a-4c34-4808-86d6-776728f25878 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.124915 May 26 13:27:18.144650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 909/1844] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:18 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:27:18.231325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5c98a91f-47bd-4d2e-9cab-417a4bf70f5a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:18.245483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5c98a91f-47bd-4d2e-9cab-417a4bf70f5a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1577 microversion: 2.1 time: 0.193424 May 26 13:27:18.246073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 936/1845] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:18 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:19.161314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0f7ef10d-c917-4702-8244-aa3f4cfa24e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:19.161923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0f7ef10d-c917-4702-8244-aa3f4cfa24e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:19.168072 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f7ef10d-c917-4702-8244-aa3f4cfa24e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:19.168519 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f7ef10d-c917-4702-8244-aa3f4cfa24e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:19.169400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f7ef10d-c917-4702-8244-aa3f4cfa24e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:19.169839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f7ef10d-c917-4702-8244-aa3f4cfa24e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:19.233051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0f7ef10d-c917-4702-8244-aa3f4cfa24e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:19.241485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f7ef10d-c917-4702-8244-aa3f4cfa24e2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.084000 May 26 13:27:19.242124 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 910/1846] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:19 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:19.263531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb978057-e3c9-4cfc-a6d4-eb52b0ee345c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:19.264816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb978057-e3c9-4cfc-a6d4-eb52b0ee345c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:19.271624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb978057-e3c9-4cfc-a6d4-eb52b0ee345c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:19.272180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb978057-e3c9-4cfc-a6d4-eb52b0ee345c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:19.272994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb978057-e3c9-4cfc-a6d4-eb52b0ee345c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:19.273435 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb978057-e3c9-4cfc-a6d4-eb52b0ee345c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:19.596507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb978057-e3c9-4cfc-a6d4-eb52b0ee345c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:19.604390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb978057-e3c9-4cfc-a6d4-eb52b0ee345c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1458 microversion: 2.1 time: 0.345566 May 26 13:27:19.604965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 937/1847] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:19 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1458 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:19.973555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2b5c9181-7a4e-4feb-af77-94abc7405d07 req-7ddb2902-8d32-4ebd-98ad-e76aad02e603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d4069d-fe62-4f1e-b4ad-ed907dbf2b99", "name": "network-vif-deleted", "tag": "bd3badd8-5652-406f-8c25-159b3d8554a1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:27:19.983354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2b5c9181-7a4e-4feb-af77-94abc7405d07 req-7ddb2902-8d32-4ebd-98ad-e76aad02e603 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:19.983803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2b5c9181-7a4e-4feb-af77-94abc7405d07 req-7ddb2902-8d32-4ebd-98ad-e76aad02e603 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:19.995622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2b5c9181-7a4e-4feb-af77-94abc7405d07 req-7ddb2902-8d32-4ebd-98ad-e76aad02e603 service nova] Creating event network-vif-deleted:bd3badd8-5652-406f-8c25-159b3d8554a1 for instance 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 on hv-cinder-81514 May 26 13:27:20.004308 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2b5c9181-7a4e-4feb-af77-94abc7405d07 req-7ddb2902-8d32-4ebd-98ad-e76aad02e603 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034686 May 26 13:27:20.004933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 911/1848] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:27:20.258773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6d1ae39-c1c0-47ae-a36c-38320b69386e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:20.259423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6d1ae39-c1c0-47ae-a36c-38320b69386e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: a03f3c20-ca70-497d-a163-d7c152799be2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:20.266508 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6d1ae39-c1c0-47ae-a36c-38320b69386e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:20.267255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6d1ae39-c1c0-47ae-a36c-38320b69386e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:20.267768 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6d1ae39-c1c0-47ae-a36c-38320b69386e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:20.268208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6d1ae39-c1c0-47ae-a36c-38320b69386e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:20.339386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6d1ae39-c1c0-47ae-a36c-38320b69386e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:20.348910 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f6d1ae39-c1c0-47ae-a36c-38320b69386e tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2" status: 200 len: 1350 microversion: 2.1 time: 0.094071 May 26 13:27:20.349569 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 938/1849] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:20 2022] GET /compute/v2.1/servers/a03f3c20-ca70-497d-a163-d7c152799be2 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:20.680023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e1e3e83-1d8b-433f-86c4-c77bd5fc34ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:20.680730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e1e3e83-1d8b-433f-86c4-c77bd5fc34ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:20.687594 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e1e3e83-1d8b-433f-86c4-c77bd5fc34ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:20.688052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e1e3e83-1d8b-433f-86c4-c77bd5fc34ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:20.688812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e1e3e83-1d8b-433f-86c4-c77bd5fc34ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:20.689248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e1e3e83-1d8b-433f-86c4-c77bd5fc34ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:20.753807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e1e3e83-1d8b-433f-86c4-c77bd5fc34ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:20.761560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e1e3e83-1d8b-433f-86c4-c77bd5fc34ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.144042 May 26 13:27:20.762883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 912/1850] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:20 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:21.779965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec525c6d-c3c2-4781-88ff-137ecb2fd545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:21.780618 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec525c6d-c3c2-4781-88ff-137ecb2fd545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:21.787133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec525c6d-c3c2-4781-88ff-137ecb2fd545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:21.787543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec525c6d-c3c2-4781-88ff-137ecb2fd545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:21.788316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec525c6d-c3c2-4781-88ff-137ecb2fd545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:21.788754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec525c6d-c3c2-4781-88ff-137ecb2fd545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:21.852566 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec525c6d-c3c2-4781-88ff-137ecb2fd545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:21.860643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec525c6d-c3c2-4781-88ff-137ecb2fd545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085256 May 26 13:27:21.861224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 939/1851] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:21 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:22.877220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a607d554-818a-4389-b44c-24b58cacd0ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:22.877959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a607d554-818a-4389-b44c-24b58cacd0ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:22.884906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a607d554-818a-4389-b44c-24b58cacd0ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:22.885342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a607d554-818a-4389-b44c-24b58cacd0ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:22.886114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a607d554-818a-4389-b44c-24b58cacd0ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:22.886577 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a607d554-818a-4389-b44c-24b58cacd0ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:22.951400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a607d554-818a-4389-b44c-24b58cacd0ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:22.959042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a607d554-818a-4389-b44c-24b58cacd0ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085823 May 26 13:27:22.959608 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 913/1852] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:22 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:23.976706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-713e8130-bacb-4dab-9fc2-31a6f30835f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:23.977597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-713e8130-bacb-4dab-9fc2-31a6f30835f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:23.984527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-713e8130-bacb-4dab-9fc2-31a6f30835f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:23.984971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-713e8130-bacb-4dab-9fc2-31a6f30835f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:23.985727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-713e8130-bacb-4dab-9fc2-31a6f30835f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:23.986163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-713e8130-bacb-4dab-9fc2-31a6f30835f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:24.046576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-713e8130-bacb-4dab-9fc2-31a6f30835f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:24.053966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-713e8130-bacb-4dab-9fc2-31a6f30835f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081296 May 26 13:27:24.054548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 940/1853] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:23 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:25.071718 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff6b38b5-4a0c-4192-bc98-9e4a70d522f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:25.072346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff6b38b5-4a0c-4192-bc98-9e4a70d522f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:25.079445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff6b38b5-4a0c-4192-bc98-9e4a70d522f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:25.079899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff6b38b5-4a0c-4192-bc98-9e4a70d522f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:25.080682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff6b38b5-4a0c-4192-bc98-9e4a70d522f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:25.081123 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff6b38b5-4a0c-4192-bc98-9e4a70d522f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:25.144637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff6b38b5-4a0c-4192-bc98-9e4a70d522f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:25.152141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff6b38b5-4a0c-4192-bc98-9e4a70d522f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084373 May 26 13:27:25.152711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 914/1854] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:25 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:26.170571 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f4d7f30c-9ee9-40f4-aef3-ed4976598c93 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:26.171220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f4d7f30c-9ee9-40f4-aef3-ed4976598c93 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:26.178032 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4d7f30c-9ee9-40f4-aef3-ed4976598c93 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:26.178488 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4d7f30c-9ee9-40f4-aef3-ed4976598c93 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:26.179287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4d7f30c-9ee9-40f4-aef3-ed4976598c93 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:26.179722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4d7f30c-9ee9-40f4-aef3-ed4976598c93 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:26.183726 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:27:26.244617 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4d7f30c-9ee9-40f4-aef3-ed4976598c93 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:26.253361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f4d7f30c-9ee9-40f4-aef3-ed4976598c93 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087462 May 26 13:27:26.253999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 941/1855] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:26 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:27.270230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56a6c28a-61ee-4605-b2ce-3856dcc4b56d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:27.270879 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56a6c28a-61ee-4605-b2ce-3856dcc4b56d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:27.277413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56a6c28a-61ee-4605-b2ce-3856dcc4b56d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:27.277867 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56a6c28a-61ee-4605-b2ce-3856dcc4b56d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:27.278727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56a6c28a-61ee-4605-b2ce-3856dcc4b56d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:27.279816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56a6c28a-61ee-4605-b2ce-3856dcc4b56d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:27.340000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56a6c28a-61ee-4605-b2ce-3856dcc4b56d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:27.348346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56a6c28a-61ee-4605-b2ce-3856dcc4b56d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081911 May 26 13:27:27.348914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 915/1856] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:27 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:28.365285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a56482d-a024-4778-bfe0-93a8b2887c1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:28.366605 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a56482d-a024-4778-bfe0-93a8b2887c1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:28.369326 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:27:28.374465 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a56482d-a024-4778-bfe0-93a8b2887c1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:28.378715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a56482d-a024-4778-bfe0-93a8b2887c1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:28.378715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a56482d-a024-4778-bfe0-93a8b2887c1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:28.378715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a56482d-a024-4778-bfe0-93a8b2887c1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:28.437933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a56482d-a024-4778-bfe0-93a8b2887c1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:28.445396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a56482d-a024-4778-bfe0-93a8b2887c1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084099 May 26 13:27:28.445962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 942/1857] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:28 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:29.462369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4856cbce-6261-481d-ab11-a7000a83777e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:29.463026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4856cbce-6261-481d-ab11-a7000a83777e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:29.465534 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=34 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:27:29.471334 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4856cbce-6261-481d-ab11-a7000a83777e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:29.471951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4856cbce-6261-481d-ab11-a7000a83777e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:29.472731 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4856cbce-6261-481d-ab11-a7000a83777e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:29.473176 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4856cbce-6261-481d-ab11-a7000a83777e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:29.537376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4856cbce-6261-481d-ab11-a7000a83777e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:29.545779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4856cbce-6261-481d-ab11-a7000a83777e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087151 May 26 13:27:29.546765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 916/1858] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:29 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:30.563282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c3fff388-9d26-4fd3-8d7b-23a5659db502 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:30.563857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c3fff388-9d26-4fd3-8d7b-23a5659db502 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:30.570959 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3fff388-9d26-4fd3-8d7b-23a5659db502 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:30.571417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3fff388-9d26-4fd3-8d7b-23a5659db502 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:30.572193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3fff388-9d26-4fd3-8d7b-23a5659db502 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:30.572636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3fff388-9d26-4fd3-8d7b-23a5659db502 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:30.896457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c3fff388-9d26-4fd3-8d7b-23a5659db502 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:30.904869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c3fff388-9d26-4fd3-8d7b-23a5659db502 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.346149 May 26 13:27:30.905431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 943/1859] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:30 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:31.922274 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aca0d801-f304-430f-ac55-afe345599ef2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:31.922908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aca0d801-f304-430f-ac55-afe345599ef2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:31.931286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aca0d801-f304-430f-ac55-afe345599ef2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:31.931286 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aca0d801-f304-430f-ac55-afe345599ef2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:31.932106 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aca0d801-f304-430f-ac55-afe345599ef2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:31.932558 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aca0d801-f304-430f-ac55-afe345599ef2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:31.935503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=94 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:27:31.996279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aca0d801-f304-430f-ac55-afe345599ef2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:32.004387 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aca0d801-f304-430f-ac55-afe345599ef2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086762 May 26 13:27:32.005136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 917/1860] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:31 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:33.022754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff3a6820-504d-4fb4-aa35-56ed840358c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:33.023307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff3a6820-504d-4fb4-aa35-56ed840358c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:33.029864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff3a6820-504d-4fb4-aa35-56ed840358c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:33.030622 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff3a6820-504d-4fb4-aa35-56ed840358c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:33.031837 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff3a6820-504d-4fb4-aa35-56ed840358c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:33.032496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff3a6820-504d-4fb4-aa35-56ed840358c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:33.093576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff3a6820-504d-4fb4-aa35-56ed840358c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:33.101110 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff3a6820-504d-4fb4-aa35-56ed840358c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082326 May 26 13:27:33.101670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 944/1861] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:33 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:34.119311 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fa4d973d-8651-4b8a-ae4d-2323543dda33 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:34.119926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fa4d973d-8651-4b8a-ae4d-2323543dda33 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:34.127411 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa4d973d-8651-4b8a-ae4d-2323543dda33 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:34.127870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa4d973d-8651-4b8a-ae4d-2323543dda33 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:34.128644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa4d973d-8651-4b8a-ae4d-2323543dda33 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:34.129085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa4d973d-8651-4b8a-ae4d-2323543dda33 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:34.191223 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fa4d973d-8651-4b8a-ae4d-2323543dda33 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:34.198734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fa4d973d-8651-4b8a-ae4d-2323543dda33 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083654 May 26 13:27:34.199235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 918/1862] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:34 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:35.216534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fdbbc9ac-faa0-4a98-8541-968f7aa42adf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:35.217131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fdbbc9ac-faa0-4a98-8541-968f7aa42adf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:35.224464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdbbc9ac-faa0-4a98-8541-968f7aa42adf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:35.224920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdbbc9ac-faa0-4a98-8541-968f7aa42adf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:35.225673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdbbc9ac-faa0-4a98-8541-968f7aa42adf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:35.226153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdbbc9ac-faa0-4a98-8541-968f7aa42adf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:35.288462 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fdbbc9ac-faa0-4a98-8541-968f7aa42adf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:35.295923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fdbbc9ac-faa0-4a98-8541-968f7aa42adf tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083461 May 26 13:27:35.296487 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 945/1863] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:35 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:36.312565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e053d2cf-6d7d-405a-afae-ddd61a5a2bd9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:36.313531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e053d2cf-6d7d-405a-afae-ddd61a5a2bd9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:36.319866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e053d2cf-6d7d-405a-afae-ddd61a5a2bd9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:36.320313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e053d2cf-6d7d-405a-afae-ddd61a5a2bd9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:36.321072 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e053d2cf-6d7d-405a-afae-ddd61a5a2bd9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:36.321518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e053d2cf-6d7d-405a-afae-ddd61a5a2bd9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:36.383073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e053d2cf-6d7d-405a-afae-ddd61a5a2bd9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:36.390706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e053d2cf-6d7d-405a-afae-ddd61a5a2bd9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081991 May 26 13:27:36.391438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 919/1864] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:36 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:37.407432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b142559f-ee5b-4119-8c45-a7f9aa3d26a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:37.408030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b142559f-ee5b-4119-8c45-a7f9aa3d26a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:37.414601 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b142559f-ee5b-4119-8c45-a7f9aa3d26a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:37.415051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b142559f-ee5b-4119-8c45-a7f9aa3d26a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:37.415807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b142559f-ee5b-4119-8c45-a7f9aa3d26a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:37.416240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b142559f-ee5b-4119-8c45-a7f9aa3d26a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:37.476874 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b142559f-ee5b-4119-8c45-a7f9aa3d26a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:37.485707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b142559f-ee5b-4119-8c45-a7f9aa3d26a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081566 May 26 13:27:37.486417 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 946/1865] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:37 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:38.503473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b139e642-7b5d-4f69-ae9d-086ed9372c84 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:38.504288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b139e642-7b5d-4f69-ae9d-086ed9372c84 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:38.511802 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b139e642-7b5d-4f69-ae9d-086ed9372c84 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:38.512251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b139e642-7b5d-4f69-ae9d-086ed9372c84 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:38.513033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b139e642-7b5d-4f69-ae9d-086ed9372c84 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:38.513475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b139e642-7b5d-4f69-ae9d-086ed9372c84 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:38.577614 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b139e642-7b5d-4f69-ae9d-086ed9372c84 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:38.586337 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b139e642-7b5d-4f69-ae9d-086ed9372c84 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087648 May 26 13:27:38.586932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 920/1866] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:38 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:27:39.603855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7fb8bfb6-39a5-4b26-ab1f-fb6d0e99e727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:39.604429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7fb8bfb6-39a5-4b26-ab1f-fb6d0e99e727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:39.611004 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7fb8bfb6-39a5-4b26-ab1f-fb6d0e99e727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:39.611809 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7fb8bfb6-39a5-4b26-ab1f-fb6d0e99e727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:39.612748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7fb8bfb6-39a5-4b26-ab1f-fb6d0e99e727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:39.613187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7fb8bfb6-39a5-4b26-ab1f-fb6d0e99e727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:39.678634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7fb8bfb6-39a5-4b26-ab1f-fb6d0e99e727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:39.686217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7fb8bfb6-39a5-4b26-ab1f-fb6d0e99e727 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086896 May 26 13:27:39.686831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 947/1867] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:39 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:40.702699 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19247ea8-02da-4f6a-b287-75f7efb821f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:40.703314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19247ea8-02da-4f6a-b287-75f7efb821f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:40.710226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19247ea8-02da-4f6a-b287-75f7efb821f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:40.710724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19247ea8-02da-4f6a-b287-75f7efb821f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:40.711514 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19247ea8-02da-4f6a-b287-75f7efb821f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:40.711956 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19247ea8-02da-4f6a-b287-75f7efb821f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:40.773567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19247ea8-02da-4f6a-b287-75f7efb821f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:40.781303 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19247ea8-02da-4f6a-b287-75f7efb821f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082510 May 26 13:27:40.781870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 921/1868] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:40 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:41.798670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb45ad63-95f1-4eec-866c-f626c35a8132 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:41.799803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb45ad63-95f1-4eec-866c-f626c35a8132 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:41.806502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb45ad63-95f1-4eec-866c-f626c35a8132 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:41.807007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb45ad63-95f1-4eec-866c-f626c35a8132 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:41.807755 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb45ad63-95f1-4eec-866c-f626c35a8132 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:41.808191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb45ad63-95f1-4eec-866c-f626c35a8132 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:41.872659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cb45ad63-95f1-4eec-866c-f626c35a8132 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:41.880823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb45ad63-95f1-4eec-866c-f626c35a8132 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086046 May 26 13:27:41.881389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 948/1869] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:41 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:42.898499 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9d01f691-bfd5-409a-ac02-2702db572e2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:42.899136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9d01f691-bfd5-409a-ac02-2702db572e2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:42.905776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d01f691-bfd5-409a-ac02-2702db572e2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:42.906234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d01f691-bfd5-409a-ac02-2702db572e2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:42.907038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d01f691-bfd5-409a-ac02-2702db572e2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:42.907496 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d01f691-bfd5-409a-ac02-2702db572e2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:42.971731 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d01f691-bfd5-409a-ac02-2702db572e2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:42.979861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9d01f691-bfd5-409a-ac02-2702db572e2f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085277 May 26 13:27:42.980439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 922/1870] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:42 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:43.996904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-59aa1159-a198-466b-ad53-82c82e8554fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:43.997586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-59aa1159-a198-466b-ad53-82c82e8554fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:44.004366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59aa1159-a198-466b-ad53-82c82e8554fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:44.004816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59aa1159-a198-466b-ad53-82c82e8554fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:44.005580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59aa1159-a198-466b-ad53-82c82e8554fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:44.006011 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59aa1159-a198-466b-ad53-82c82e8554fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:44.066827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-59aa1159-a198-466b-ad53-82c82e8554fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:44.074287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-59aa1159-a198-466b-ad53-82c82e8554fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081570 May 26 13:27:44.075028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 949/1871] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:43 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:45.091899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd88e0e9-5a00-446d-87ae-4e222ee609d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:45.092534 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd88e0e9-5a00-446d-87ae-4e222ee609d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:45.099675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd88e0e9-5a00-446d-87ae-4e222ee609d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:45.100120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd88e0e9-5a00-446d-87ae-4e222ee609d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:45.100912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd88e0e9-5a00-446d-87ae-4e222ee609d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:45.101346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd88e0e9-5a00-446d-87ae-4e222ee609d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:45.163370 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd88e0e9-5a00-446d-87ae-4e222ee609d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:45.171027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd88e0e9-5a00-446d-87ae-4e222ee609d4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083137 May 26 13:27:45.171595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 923/1872] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:45 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:45.827770 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:27:45.832248 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:27:46.189554 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0631a7d7-5ea3-4c34-a088-dbc8b70ff588 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:46.190183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0631a7d7-5ea3-4c34-a088-dbc8b70ff588 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:46.197556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0631a7d7-5ea3-4c34-a088-dbc8b70ff588 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:46.198000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0631a7d7-5ea3-4c34-a088-dbc8b70ff588 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:46.198798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0631a7d7-5ea3-4c34-a088-dbc8b70ff588 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:46.199237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0631a7d7-5ea3-4c34-a088-dbc8b70ff588 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:46.262923 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0631a7d7-5ea3-4c34-a088-dbc8b70ff588 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:46.270853 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0631a7d7-5ea3-4c34-a088-dbc8b70ff588 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085948 May 26 13:27:46.271507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 950/1873] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:46 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:47.287937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-522aa155-0464-4390-87af-fb4a6cd752aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:47.288718 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-522aa155-0464-4390-87af-fb4a6cd752aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:47.295569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-522aa155-0464-4390-87af-fb4a6cd752aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:47.296025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-522aa155-0464-4390-87af-fb4a6cd752aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:47.296804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-522aa155-0464-4390-87af-fb4a6cd752aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:47.297245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-522aa155-0464-4390-87af-fb4a6cd752aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:47.361565 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-522aa155-0464-4390-87af-fb4a6cd752aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:47.369902 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-522aa155-0464-4390-87af-fb4a6cd752aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085850 May 26 13:27:47.370404 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 924/1874] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:47 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:48.388267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d8a7ff15-b3ac-4466-9e80-daf6a4293732 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:48.388944 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d8a7ff15-b3ac-4466-9e80-daf6a4293732 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:48.395918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8a7ff15-b3ac-4466-9e80-daf6a4293732 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:48.403012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8a7ff15-b3ac-4466-9e80-daf6a4293732 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:48.403012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8a7ff15-b3ac-4466-9e80-daf6a4293732 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:48.403012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8a7ff15-b3ac-4466-9e80-daf6a4293732 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:48.471738 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d8a7ff15-b3ac-4466-9e80-daf6a4293732 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:48.480316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d8a7ff15-b3ac-4466-9e80-daf6a4293732 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.096578 May 26 13:27:48.481101 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 951/1875] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:48 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:49.498808 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-189f7a31-7217-4583-96d0-66a5a5c4883c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:49.499449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-189f7a31-7217-4583-96d0-66a5a5c4883c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:49.505530 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-189f7a31-7217-4583-96d0-66a5a5c4883c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:49.506052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-189f7a31-7217-4583-96d0-66a5a5c4883c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:49.506908 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-189f7a31-7217-4583-96d0-66a5a5c4883c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:49.507228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-189f7a31-7217-4583-96d0-66a5a5c4883c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:49.568481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-189f7a31-7217-4583-96d0-66a5a5c4883c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:49.576202 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-189f7a31-7217-4583-96d0-66a5a5c4883c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081586 May 26 13:27:49.576789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 925/1876] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:49 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:50.594000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a9d77a95-c9db-4e47-be46-c49c58281570 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:50.594590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a9d77a95-c9db-4e47-be46-c49c58281570 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:50.601208 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9d77a95-c9db-4e47-be46-c49c58281570 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:50.601657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9d77a95-c9db-4e47-be46-c49c58281570 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:50.602780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9d77a95-c9db-4e47-be46-c49c58281570 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:50.603413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9d77a95-c9db-4e47-be46-c49c58281570 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:50.665883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a9d77a95-c9db-4e47-be46-c49c58281570 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:50.673496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a9d77a95-c9db-4e47-be46-c49c58281570 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083439 May 26 13:27:50.674071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 952/1877] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:50 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:51.691085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f0d1c882-b638-4f35-a56f-2bcfe64759ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:51.691686 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f0d1c882-b638-4f35-a56f-2bcfe64759ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:51.698241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0d1c882-b638-4f35-a56f-2bcfe64759ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:51.698727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0d1c882-b638-4f35-a56f-2bcfe64759ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:51.699494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0d1c882-b638-4f35-a56f-2bcfe64759ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:51.699957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0d1c882-b638-4f35-a56f-2bcfe64759ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:51.761371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f0d1c882-b638-4f35-a56f-2bcfe64759ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:51.768865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f0d1c882-b638-4f35-a56f-2bcfe64759ac tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081674 May 26 13:27:51.769429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 926/1878] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:51 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:52.786469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c685daa9-7e1e-4cb3-b9b2-14da6910a466 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:52.787124 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c685daa9-7e1e-4cb3-b9b2-14da6910a466 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:52.793505 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c685daa9-7e1e-4cb3-b9b2-14da6910a466 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:52.793953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c685daa9-7e1e-4cb3-b9b2-14da6910a466 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:52.794766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c685daa9-7e1e-4cb3-b9b2-14da6910a466 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:52.795206 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c685daa9-7e1e-4cb3-b9b2-14da6910a466 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:52.855761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c685daa9-7e1e-4cb3-b9b2-14da6910a466 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:52.863399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c685daa9-7e1e-4cb3-b9b2-14da6910a466 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080848 May 26 13:27:52.863968 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 953/1879] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:52 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:53.880090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-098140ef-f07c-43e6-83ae-616d1316bf58 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:53.880704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-098140ef-f07c-43e6-83ae-616d1316bf58 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:53.887714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-098140ef-f07c-43e6-83ae-616d1316bf58 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:53.888166 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-098140ef-f07c-43e6-83ae-616d1316bf58 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:53.888939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-098140ef-f07c-43e6-83ae-616d1316bf58 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:53.889381 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-098140ef-f07c-43e6-83ae-616d1316bf58 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:53.952657 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-098140ef-f07c-43e6-83ae-616d1316bf58 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:53.959910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-098140ef-f07c-43e6-83ae-616d1316bf58 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083971 May 26 13:27:53.960486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 927/1880] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:53 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:54.978388 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d65a0d6d-592c-462d-b45d-f3bc65360d90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:54.979032 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d65a0d6d-592c-462d-b45d-f3bc65360d90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:54.986838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d65a0d6d-592c-462d-b45d-f3bc65360d90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:54.987292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d65a0d6d-592c-462d-b45d-f3bc65360d90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:54.988065 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d65a0d6d-592c-462d-b45d-f3bc65360d90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:54.988503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d65a0d6d-592c-462d-b45d-f3bc65360d90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:55.050873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d65a0d6d-592c-462d-b45d-f3bc65360d90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:55.059311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d65a0d6d-592c-462d-b45d-f3bc65360d90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084999 May 26 13:27:55.059886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 954/1881] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:54 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:56.076980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-252cfaba-d8fd-4b34-8eaf-eb66f199b32e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:56.077612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-252cfaba-d8fd-4b34-8eaf-eb66f199b32e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:56.084298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-252cfaba-d8fd-4b34-8eaf-eb66f199b32e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:56.084744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-252cfaba-d8fd-4b34-8eaf-eb66f199b32e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:56.085511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-252cfaba-d8fd-4b34-8eaf-eb66f199b32e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:56.085948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-252cfaba-d8fd-4b34-8eaf-eb66f199b32e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:56.149993 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-252cfaba-d8fd-4b34-8eaf-eb66f199b32e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:56.158210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-252cfaba-d8fd-4b34-8eaf-eb66f199b32e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085708 May 26 13:27:56.158803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 928/1882] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:56 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:57.175785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-edbfa147-ba17-4803-864b-c4475c2e0af6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:57.176428 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-edbfa147-ba17-4803-864b-c4475c2e0af6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:57.183196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edbfa147-ba17-4803-864b-c4475c2e0af6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:57.183663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edbfa147-ba17-4803-864b-c4475c2e0af6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:57.184447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edbfa147-ba17-4803-864b-c4475c2e0af6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:57.184887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edbfa147-ba17-4803-864b-c4475c2e0af6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:57.252053 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-edbfa147-ba17-4803-864b-c4475c2e0af6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:57.259906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-edbfa147-ba17-4803-864b-c4475c2e0af6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088033 May 26 13:27:57.260490 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 955/1883] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:57 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:27:58.277703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ddc4a097-a843-4254-9515-1154946e5fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:58.278472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ddc4a097-a843-4254-9515-1154946e5fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:58.285352 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc4a097-a843-4254-9515-1154946e5fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:58.285799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc4a097-a843-4254-9515-1154946e5fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:58.286605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc4a097-a843-4254-9515-1154946e5fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:58.287044 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc4a097-a843-4254-9515-1154946e5fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:58.352028 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ddc4a097-a843-4254-9515-1154946e5fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:58.361053 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ddc4a097-a843-4254-9515-1154946e5fc1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087435 May 26 13:27:58.363494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 929/1884] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:58 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:27:59.378128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91ad1a14-862a-4f82-ba38-b81503ab1744 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:27:59.379386 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-91ad1a14-862a-4f82-ba38-b81503ab1744 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:27:59.385748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91ad1a14-862a-4f82-ba38-b81503ab1744 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:59.386700 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91ad1a14-862a-4f82-ba38-b81503ab1744 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:59.387677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91ad1a14-862a-4f82-ba38-b81503ab1744 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:27:59.388122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91ad1a14-862a-4f82-ba38-b81503ab1744 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:27:59.390871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=90 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:27:59.452620 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-91ad1a14-862a-4f82-ba38-b81503ab1744 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:27:59.460552 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91ad1a14-862a-4f82-ba38-b81503ab1744 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087023 May 26 13:27:59.463840 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 956/1885] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:27:59 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:00.479037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-87b72bdb-c81b-409e-885f-ad9efa1cf783 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:00.479674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-87b72bdb-c81b-409e-885f-ad9efa1cf783 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:00.487127 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87b72bdb-c81b-409e-885f-ad9efa1cf783 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:00.487580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87b72bdb-c81b-409e-885f-ad9efa1cf783 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:00.488350 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87b72bdb-c81b-409e-885f-ad9efa1cf783 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:00.488793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87b72bdb-c81b-409e-885f-ad9efa1cf783 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:00.551268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-87b72bdb-c81b-409e-885f-ad9efa1cf783 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:00.559824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-87b72bdb-c81b-409e-885f-ad9efa1cf783 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084931 May 26 13:28:00.560388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 930/1886] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:00 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:01.577531 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2205969-cb0b-4cfe-82e7-4142021d0370 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:01.578175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2205969-cb0b-4cfe-82e7-4142021d0370 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:01.580705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=30 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:28:01.585516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2205969-cb0b-4cfe-82e7-4142021d0370 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:01.585975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2205969-cb0b-4cfe-82e7-4142021d0370 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:01.586773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2205969-cb0b-4cfe-82e7-4142021d0370 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:01.587210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2205969-cb0b-4cfe-82e7-4142021d0370 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:01.649788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c2205969-cb0b-4cfe-82e7-4142021d0370 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:01.657702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2205969-cb0b-4cfe-82e7-4142021d0370 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085005 May 26 13:28:01.658268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 957/1887] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:01 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:02.674552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f383e423-68d7-4ebe-ae84-fbba3d3e4703 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:02.675174 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f383e423-68d7-4ebe-ae84-fbba3d3e4703 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:02.677529 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=30 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:28:02.682290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f383e423-68d7-4ebe-ae84-fbba3d3e4703 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:02.682773 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f383e423-68d7-4ebe-ae84-fbba3d3e4703 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:02.684203 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f383e423-68d7-4ebe-ae84-fbba3d3e4703 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:02.684650 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f383e423-68d7-4ebe-ae84-fbba3d3e4703 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:02.746685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f383e423-68d7-4ebe-ae84-fbba3d3e4703 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:02.754172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f383e423-68d7-4ebe-ae84-fbba3d3e4703 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083580 May 26 13:28:02.754759 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 931/1888] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:02 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:03.771915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f58d6d18-a381-49c0-9124-44c250a37a7a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:03.772555 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f58d6d18-a381-49c0-9124-44c250a37a7a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:03.779936 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f58d6d18-a381-49c0-9124-44c250a37a7a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:03.780382 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f58d6d18-a381-49c0-9124-44c250a37a7a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:03.781144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f58d6d18-a381-49c0-9124-44c250a37a7a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:03.781585 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f58d6d18-a381-49c0-9124-44c250a37a7a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:03.845017 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f58d6d18-a381-49c0-9124-44c250a37a7a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:03.852988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f58d6d18-a381-49c0-9124-44c250a37a7a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084894 May 26 13:28:03.853548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 958/1889] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:03 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:04.870806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ebdabc1-7e08-4e21-93a1-18ead2f21102 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:04.871405 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ebdabc1-7e08-4e21-93a1-18ead2f21102 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:04.878783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ebdabc1-7e08-4e21-93a1-18ead2f21102 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:04.879241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ebdabc1-7e08-4e21-93a1-18ead2f21102 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:04.880009 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ebdabc1-7e08-4e21-93a1-18ead2f21102 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:04.880451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ebdabc1-7e08-4e21-93a1-18ead2f21102 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:04.883063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=90 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:28:04.944973 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ebdabc1-7e08-4e21-93a1-18ead2f21102 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:04.952963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ebdabc1-7e08-4e21-93a1-18ead2f21102 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086235 May 26 13:28:04.953667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 932/1890] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:04 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:05.969714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c0e1457e-5098-4dd8-b22d-ac6946ca8fed tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:05.970420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c0e1457e-5098-4dd8-b22d-ac6946ca8fed tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:05.976915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e1457e-5098-4dd8-b22d-ac6946ca8fed tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:05.977672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e1457e-5098-4dd8-b22d-ac6946ca8fed tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:05.978447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e1457e-5098-4dd8-b22d-ac6946ca8fed tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:05.978913 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e1457e-5098-4dd8-b22d-ac6946ca8fed tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:06.043843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0e1457e-5098-4dd8-b22d-ac6946ca8fed tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:06.052277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c0e1457e-5098-4dd8-b22d-ac6946ca8fed tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086930 May 26 13:28:06.052854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 959/1891] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:05 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:07.069776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff4933ac-9e6d-4717-a874-41b6b41432eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:07.070400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff4933ac-9e6d-4717-a874-41b6b41432eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:07.077133 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff4933ac-9e6d-4717-a874-41b6b41432eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:07.077595 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff4933ac-9e6d-4717-a874-41b6b41432eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:07.079095 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff4933ac-9e6d-4717-a874-41b6b41432eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:07.079544 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff4933ac-9e6d-4717-a874-41b6b41432eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:07.141903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff4933ac-9e6d-4717-a874-41b6b41432eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:07.149569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff4933ac-9e6d-4717-a874-41b6b41432eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083925 May 26 13:28:07.150142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 933/1892] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:07 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:08.167323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10e10b01-d27e-469a-a908-0058d6ea9295 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:08.167928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10e10b01-d27e-469a-a908-0058d6ea9295 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:08.175076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10e10b01-d27e-469a-a908-0058d6ea9295 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:08.175536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10e10b01-d27e-469a-a908-0058d6ea9295 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:08.176304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10e10b01-d27e-469a-a908-0058d6ea9295 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:08.176746 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10e10b01-d27e-469a-a908-0058d6ea9295 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:08.239212 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10e10b01-d27e-469a-a908-0058d6ea9295 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:08.246981 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10e10b01-d27e-469a-a908-0058d6ea9295 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083539 May 26 13:28:08.247552 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 960/1893] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:08 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:09.264186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57f51a80-d5ce-4a02-834a-70e1640fe72a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:09.264780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57f51a80-d5ce-4a02-834a-70e1640fe72a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:09.271979 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57f51a80-d5ce-4a02-834a-70e1640fe72a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:09.272434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57f51a80-d5ce-4a02-834a-70e1640fe72a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:09.273222 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57f51a80-d5ce-4a02-834a-70e1640fe72a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:09.273658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57f51a80-d5ce-4a02-834a-70e1640fe72a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:09.334568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57f51a80-d5ce-4a02-834a-70e1640fe72a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:09.342060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57f51a80-d5ce-4a02-834a-70e1640fe72a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081787 May 26 13:28:09.342637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 934/1894] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:09 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:10.360137 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c83f5a49-6205-4baa-8c40-57544ab9000c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:10.360918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c83f5a49-6205-4baa-8c40-57544ab9000c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:10.367445 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c83f5a49-6205-4baa-8c40-57544ab9000c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:10.367891 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c83f5a49-6205-4baa-8c40-57544ab9000c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:10.368655 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c83f5a49-6205-4baa-8c40-57544ab9000c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:10.369098 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c83f5a49-6205-4baa-8c40-57544ab9000c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:10.431084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c83f5a49-6205-4baa-8c40-57544ab9000c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:10.438800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c83f5a49-6205-4baa-8c40-57544ab9000c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083078 May 26 13:28:10.439366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 961/1895] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:10 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:11.455876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8fe8895b-cdcf-4f91-996c-6431947bc08d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:11.456489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8fe8895b-cdcf-4f91-996c-6431947bc08d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:11.463031 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fe8895b-cdcf-4f91-996c-6431947bc08d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:11.463477 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fe8895b-cdcf-4f91-996c-6431947bc08d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:11.464266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fe8895b-cdcf-4f91-996c-6431947bc08d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:11.464702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fe8895b-cdcf-4f91-996c-6431947bc08d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:11.525376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8fe8895b-cdcf-4f91-996c-6431947bc08d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:11.533181 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8fe8895b-cdcf-4f91-996c-6431947bc08d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081200 May 26 13:28:11.533702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 935/1896] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:11 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:12.549583 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-95a1917e-d2a3-4562-a0a2-6eeaf5c6373e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:12.550139 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-95a1917e-d2a3-4562-a0a2-6eeaf5c6373e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:12.556657 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95a1917e-d2a3-4562-a0a2-6eeaf5c6373e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:12.557114 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95a1917e-d2a3-4562-a0a2-6eeaf5c6373e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:12.557886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95a1917e-d2a3-4562-a0a2-6eeaf5c6373e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:12.558332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95a1917e-d2a3-4562-a0a2-6eeaf5c6373e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:12.625780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-95a1917e-d2a3-4562-a0a2-6eeaf5c6373e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:12.633753 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-95a1917e-d2a3-4562-a0a2-6eeaf5c6373e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088331 May 26 13:28:12.634339 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 962/1897] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:12 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:13.651344 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b607b176-566d-4901-a9ab-61364e493d11 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:13.651989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b607b176-566d-4901-a9ab-61364e493d11 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:13.659122 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b607b176-566d-4901-a9ab-61364e493d11 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:13.659579 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b607b176-566d-4901-a9ab-61364e493d11 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:13.660355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b607b176-566d-4901-a9ab-61364e493d11 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:13.660800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b607b176-566d-4901-a9ab-61364e493d11 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:13.727748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b607b176-566d-4901-a9ab-61364e493d11 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:13.734285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b607b176-566d-4901-a9ab-61364e493d11 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086842 May 26 13:28:13.735767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 936/1898] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:13 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:14.753702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c14023e0-12f7-4563-9e74-c479acf86873 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:14.754357 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c14023e0-12f7-4563-9e74-c479acf86873 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:14.761012 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c14023e0-12f7-4563-9e74-c479acf86873 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:14.761461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c14023e0-12f7-4563-9e74-c479acf86873 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:14.762232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c14023e0-12f7-4563-9e74-c479acf86873 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:14.762709 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c14023e0-12f7-4563-9e74-c479acf86873 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:14.832650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c14023e0-12f7-4563-9e74-c479acf86873 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:14.841796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c14023e0-12f7-4563-9e74-c479acf86873 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092649 May 26 13:28:14.842369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 963/1899] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:14 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:15.859000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b17cbc0-704c-4867-8ad6-95db22601e17 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:15.859662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b17cbc0-704c-4867-8ad6-95db22601e17 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:15.866294 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b17cbc0-704c-4867-8ad6-95db22601e17 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:15.871178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b17cbc0-704c-4867-8ad6-95db22601e17 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:15.871178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b17cbc0-704c-4867-8ad6-95db22601e17 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:15.871178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b17cbc0-704c-4867-8ad6-95db22601e17 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:15.934345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b17cbc0-704c-4867-8ad6-95db22601e17 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:15.942436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b17cbc0-704c-4867-8ad6-95db22601e17 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087363 May 26 13:28:15.943038 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 937/1900] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:15 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:16.960287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f224460b-2209-4ee6-be76-9931029c7280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:16.960928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f224460b-2209-4ee6-be76-9931029c7280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:16.967556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f224460b-2209-4ee6-be76-9931029c7280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:16.968008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f224460b-2209-4ee6-be76-9931029c7280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:16.968773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f224460b-2209-4ee6-be76-9931029c7280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:16.969210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f224460b-2209-4ee6-be76-9931029c7280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:17.031988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f224460b-2209-4ee6-be76-9931029c7280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:17.040063 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f224460b-2209-4ee6-be76-9931029c7280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084925 May 26 13:28:17.040636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 964/1901] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:16 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:18.056717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05fce670-8c74-456b-8e04-05c21ccf043c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:18.057333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05fce670-8c74-456b-8e04-05c21ccf043c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:18.064058 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05fce670-8c74-456b-8e04-05c21ccf043c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:18.064518 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05fce670-8c74-456b-8e04-05c21ccf043c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:18.065625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05fce670-8c74-456b-8e04-05c21ccf043c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:18.065979 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05fce670-8c74-456b-8e04-05c21ccf043c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:18.128692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05fce670-8c74-456b-8e04-05c21ccf043c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:18.136269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05fce670-8c74-456b-8e04-05c21ccf043c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083483 May 26 13:28:18.136833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 938/1902] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:18 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:19.154221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-429a39e5-fd5e-49d4-8803-c250b73798ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:19.154852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-429a39e5-fd5e-49d4-8803-c250b73798ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:19.162189 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-429a39e5-fd5e-49d4-8803-c250b73798ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:19.162682 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-429a39e5-fd5e-49d4-8803-c250b73798ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:19.163458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-429a39e5-fd5e-49d4-8803-c250b73798ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:19.163906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-429a39e5-fd5e-49d4-8803-c250b73798ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:19.227274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-429a39e5-fd5e-49d4-8803-c250b73798ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:19.235040 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-429a39e5-fd5e-49d4-8803-c250b73798ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084731 May 26 13:28:19.235599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 965/1903] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:19 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:20.251776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7d4bb87-da37-4d1b-861c-790e97bfc065 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:20.252353 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7d4bb87-da37-4d1b-861c-790e97bfc065 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:20.258871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7d4bb87-da37-4d1b-861c-790e97bfc065 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:20.259328 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7d4bb87-da37-4d1b-861c-790e97bfc065 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:20.260102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7d4bb87-da37-4d1b-861c-790e97bfc065 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:20.260551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7d4bb87-da37-4d1b-861c-790e97bfc065 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:20.322097 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7d4bb87-da37-4d1b-861c-790e97bfc065 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:20.329522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7d4bb87-da37-4d1b-861c-790e97bfc065 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081856 May 26 13:28:20.330084 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 939/1904] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:20 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:21.347904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c9fc974f-ccd3-4323-931b-daaf2d4c7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:21.348521 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c9fc974f-ccd3-4323-931b-daaf2d4c7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:21.355567 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9fc974f-ccd3-4323-931b-daaf2d4c7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:21.356023 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9fc974f-ccd3-4323-931b-daaf2d4c7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:21.356790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9fc974f-ccd3-4323-931b-daaf2d4c7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:21.357235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9fc974f-ccd3-4323-931b-daaf2d4c7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:21.419059 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9fc974f-ccd3-4323-931b-daaf2d4c7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:21.427862 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c9fc974f-ccd3-4323-931b-daaf2d4c7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084617 May 26 13:28:21.428420 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 966/1905] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:21 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:28:22.445305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2957fb5d-3926-45b7-bcf1-9c9234eb60fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:22.445927 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2957fb5d-3926-45b7-bcf1-9c9234eb60fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:22.452531 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2957fb5d-3926-45b7-bcf1-9c9234eb60fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:22.452990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2957fb5d-3926-45b7-bcf1-9c9234eb60fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:22.453767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2957fb5d-3926-45b7-bcf1-9c9234eb60fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:22.454221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2957fb5d-3926-45b7-bcf1-9c9234eb60fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:22.517727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2957fb5d-3926-45b7-bcf1-9c9234eb60fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:22.525824 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2957fb5d-3926-45b7-bcf1-9c9234eb60fd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085045 May 26 13:28:22.526395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 940/1906] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:22 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:23.542486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d06eec54-6cf1-4ceb-b5d0-3ab0f7f5a9f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:23.552257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d06eec54-6cf1-4ceb-b5d0-3ab0f7f5a9f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:23.552257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d06eec54-6cf1-4ceb-b5d0-3ab0f7f5a9f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:23.552257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d06eec54-6cf1-4ceb-b5d0-3ab0f7f5a9f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:23.552257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d06eec54-6cf1-4ceb-b5d0-3ab0f7f5a9f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:23.552706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d06eec54-6cf1-4ceb-b5d0-3ab0f7f5a9f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:23.615031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d06eec54-6cf1-4ceb-b5d0-3ab0f7f5a9f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:23.622486 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d06eec54-6cf1-4ceb-b5d0-3ab0f7f5a9f2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083861 May 26 13:28:23.628788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 967/1907] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:23 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:24.639909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d16978f-9206-419d-a6eb-f7464806aca2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:24.640552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d16978f-9206-419d-a6eb-f7464806aca2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:24.648141 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d16978f-9206-419d-a6eb-f7464806aca2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:24.648598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d16978f-9206-419d-a6eb-f7464806aca2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:24.649375 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d16978f-9206-419d-a6eb-f7464806aca2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:24.649876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d16978f-9206-419d-a6eb-f7464806aca2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:24.967895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d16978f-9206-419d-a6eb-f7464806aca2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:24.975610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d16978f-9206-419d-a6eb-f7464806aca2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.339645 May 26 13:28:24.976168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 941/1908] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:24 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:25.992475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f3f6c4b-ed20-4983-b876-31b87236bd72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:25.993096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f3f6c4b-ed20-4983-b876-31b87236bd72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:25.999916 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f3f6c4b-ed20-4983-b876-31b87236bd72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:26.000374 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f3f6c4b-ed20-4983-b876-31b87236bd72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:26.001152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f3f6c4b-ed20-4983-b876-31b87236bd72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:26.001602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f3f6c4b-ed20-4983-b876-31b87236bd72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:26.063227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f3f6c4b-ed20-4983-b876-31b87236bd72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:26.071095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f3f6c4b-ed20-4983-b876-31b87236bd72 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082455 May 26 13:28:26.071673 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 968/1909] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:25 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:27.088376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6b7759a9-6bd3-4a21-a9f8-16da973bc5df tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:27.088947 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6b7759a9-6bd3-4a21-a9f8-16da973bc5df tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:27.099633 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b7759a9-6bd3-4a21-a9f8-16da973bc5df tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:27.100092 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b7759a9-6bd3-4a21-a9f8-16da973bc5df tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:27.100909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b7759a9-6bd3-4a21-a9f8-16da973bc5df tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:27.101359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b7759a9-6bd3-4a21-a9f8-16da973bc5df tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:27.163188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6b7759a9-6bd3-4a21-a9f8-16da973bc5df tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:27.170919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6b7759a9-6bd3-4a21-a9f8-16da973bc5df tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086569 May 26 13:28:27.171494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 942/1910] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:27 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:28.188290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c55a24a-0503-4712-a7e7-e9cb3d017c1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:28.188890 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c55a24a-0503-4712-a7e7-e9cb3d017c1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:28.195398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c55a24a-0503-4712-a7e7-e9cb3d017c1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:28.195843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c55a24a-0503-4712-a7e7-e9cb3d017c1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:28.196604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c55a24a-0503-4712-a7e7-e9cb3d017c1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:28.197039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c55a24a-0503-4712-a7e7-e9cb3d017c1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:28.262255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c55a24a-0503-4712-a7e7-e9cb3d017c1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:28.270976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c55a24a-0503-4712-a7e7-e9cb3d017c1d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086485 May 26 13:28:28.271558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 969/1911] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:28 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:29.288685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6035dbb-2c0f-49f3-9159-4b01616ac3a3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:29.289324 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6035dbb-2c0f-49f3-9159-4b01616ac3a3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:29.295870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6035dbb-2c0f-49f3-9159-4b01616ac3a3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:29.296369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6035dbb-2c0f-49f3-9159-4b01616ac3a3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:29.297148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6035dbb-2c0f-49f3-9159-4b01616ac3a3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:29.297589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6035dbb-2c0f-49f3-9159-4b01616ac3a3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:29.361098 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6035dbb-2c0f-49f3-9159-4b01616ac3a3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:29.369826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6035dbb-2c0f-49f3-9159-4b01616ac3a3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085578 May 26 13:28:29.370398 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 943/1912] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:29 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:30.386979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0edd0c68-1e9f-4740-9a39-e5364c5ce173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:30.387575 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0edd0c68-1e9f-4740-9a39-e5364c5ce173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:30.394906 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edd0c68-1e9f-4740-9a39-e5364c5ce173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:30.395390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edd0c68-1e9f-4740-9a39-e5364c5ce173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:30.396144 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edd0c68-1e9f-4740-9a39-e5364c5ce173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:30.396615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edd0c68-1e9f-4740-9a39-e5364c5ce173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:30.460034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0edd0c68-1e9f-4740-9a39-e5364c5ce173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:30.467599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0edd0c68-1e9f-4740-9a39-e5364c5ce173 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084558 May 26 13:28:30.468164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 970/1913] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:30 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:31.485239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8cdf29b3-6a4a-4d9b-aab8-c2aadd085564 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:31.485855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8cdf29b3-6a4a-4d9b-aab8-c2aadd085564 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:31.493260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cdf29b3-6a4a-4d9b-aab8-c2aadd085564 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:31.493710 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cdf29b3-6a4a-4d9b-aab8-c2aadd085564 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:31.494511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cdf29b3-6a4a-4d9b-aab8-c2aadd085564 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:31.494969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cdf29b3-6a4a-4d9b-aab8-c2aadd085564 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:31.563503 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8cdf29b3-6a4a-4d9b-aab8-c2aadd085564 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:31.571329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8cdf29b3-6a4a-4d9b-aab8-c2aadd085564 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090025 May 26 13:28:31.571899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 944/1914] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:31 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:32.588345 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91b925c1-be68-43b2-ac58-1a64f7fe0bba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:32.588899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-91b925c1-be68-43b2-ac58-1a64f7fe0bba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:32.591282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:28:32.596107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91b925c1-be68-43b2-ac58-1a64f7fe0bba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:32.596556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91b925c1-be68-43b2-ac58-1a64f7fe0bba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:32.597548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91b925c1-be68-43b2-ac58-1a64f7fe0bba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:32.597990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91b925c1-be68-43b2-ac58-1a64f7fe0bba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:32.600631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=90 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:28:32.664442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-91b925c1-be68-43b2-ac58-1a64f7fe0bba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:32.673452 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91b925c1-be68-43b2-ac58-1a64f7fe0bba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089089 May 26 13:28:32.674031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 971/1915] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:32 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:33.389784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:28:33.390068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:28:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:28:33.691512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-adf33e1b-4a33-4093-a7cd-3619319fab6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:33.692116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-adf33e1b-4a33-4093-a7cd-3619319fab6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:33.694507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:28:33.699297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adf33e1b-4a33-4093-a7cd-3619319fab6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:33.702895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adf33e1b-4a33-4093-a7cd-3619319fab6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:33.702895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adf33e1b-4a33-4093-a7cd-3619319fab6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:33.702895 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adf33e1b-4a33-4093-a7cd-3619319fab6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:33.768177 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-adf33e1b-4a33-4093-a7cd-3619319fab6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:33.773973 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-adf33e1b-4a33-4093-a7cd-3619319fab6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086930 May 26 13:28:33.774574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 945/1916] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:33 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:34.791176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-706d9979-98ab-4b20-97d2-37c9fec99b7b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:34.791813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-706d9979-98ab-4b20-97d2-37c9fec99b7b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:34.798259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-706d9979-98ab-4b20-97d2-37c9fec99b7b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:34.798745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-706d9979-98ab-4b20-97d2-37c9fec99b7b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:34.799513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-706d9979-98ab-4b20-97d2-37c9fec99b7b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:34.799943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-706d9979-98ab-4b20-97d2-37c9fec99b7b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:34.863151 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-706d9979-98ab-4b20-97d2-37c9fec99b7b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:34.870477 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-706d9979-98ab-4b20-97d2-37c9fec99b7b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083149 May 26 13:28:34.871100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 972/1917] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:34 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:35.887982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f9cedfe-1dab-4e99-8ff1-0de644b3a1a0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:35.888586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f9cedfe-1dab-4e99-8ff1-0de644b3a1a0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:35.896213 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f9cedfe-1dab-4e99-8ff1-0de644b3a1a0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:35.897801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f9cedfe-1dab-4e99-8ff1-0de644b3a1a0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:35.897801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f9cedfe-1dab-4e99-8ff1-0de644b3a1a0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:35.898062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f9cedfe-1dab-4e99-8ff1-0de644b3a1a0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:35.900857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:28:35.964190 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2f9cedfe-1dab-4e99-8ff1-0de644b3a1a0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:35.973224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f9cedfe-1dab-4e99-8ff1-0de644b3a1a0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089001 May 26 13:28:35.973815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 946/1918] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:35 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:36.990381 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a777d1a-3c20-4608-8dd2-49d7ef6358dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:36.991033 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a777d1a-3c20-4608-8dd2-49d7ef6358dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:36.997597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a777d1a-3c20-4608-8dd2-49d7ef6358dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:36.998052 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a777d1a-3c20-4608-8dd2-49d7ef6358dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:36.998843 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a777d1a-3c20-4608-8dd2-49d7ef6358dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:36.999288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a777d1a-3c20-4608-8dd2-49d7ef6358dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:37.059972 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a777d1a-3c20-4608-8dd2-49d7ef6358dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:37.067829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a777d1a-3c20-4608-8dd2-49d7ef6358dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081343 May 26 13:28:37.068330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 973/1919] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:36 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:38.084713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aef897c5-4a93-47f3-b177-8a896b2fe327 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:38.085309 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aef897c5-4a93-47f3-b177-8a896b2fe327 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:38.092070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aef897c5-4a93-47f3-b177-8a896b2fe327 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:38.092629 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aef897c5-4a93-47f3-b177-8a896b2fe327 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:38.093427 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aef897c5-4a93-47f3-b177-8a896b2fe327 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:38.093866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aef897c5-4a93-47f3-b177-8a896b2fe327 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:38.161856 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aef897c5-4a93-47f3-b177-8a896b2fe327 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:38.169827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aef897c5-4a93-47f3-b177-8a896b2fe327 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089038 May 26 13:28:38.170467 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 947/1920] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:38 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:39.187614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f7b4fae-bb7f-461c-9d67-6c7f035ac62c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:39.188214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5f7b4fae-bb7f-461c-9d67-6c7f035ac62c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:39.195471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f7b4fae-bb7f-461c-9d67-6c7f035ac62c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:39.195921 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f7b4fae-bb7f-461c-9d67-6c7f035ac62c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:39.196692 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f7b4fae-bb7f-461c-9d67-6c7f035ac62c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:39.197132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f7b4fae-bb7f-461c-9d67-6c7f035ac62c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:39.261369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5f7b4fae-bb7f-461c-9d67-6c7f035ac62c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:39.269005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f7b4fae-bb7f-461c-9d67-6c7f035ac62c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085250 May 26 13:28:39.270093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 974/1921] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:39 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:40.287332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-baaceb1f-3890-4929-b0e2-796036c52d19 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:40.287951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-baaceb1f-3890-4929-b0e2-796036c52d19 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:40.294471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baaceb1f-3890-4929-b0e2-796036c52d19 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:40.294954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baaceb1f-3890-4929-b0e2-796036c52d19 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:40.295725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baaceb1f-3890-4929-b0e2-796036c52d19 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:40.296165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baaceb1f-3890-4929-b0e2-796036c52d19 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:40.357439 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-baaceb1f-3890-4929-b0e2-796036c52d19 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:40.365862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-baaceb1f-3890-4929-b0e2-796036c52d19 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083364 May 26 13:28:40.366431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 948/1922] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:40 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:41.383338 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-297b39ee-1a4d-4dcd-a536-622e08c44ffb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:41.383965 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-297b39ee-1a4d-4dcd-a536-622e08c44ffb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:41.390474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-297b39ee-1a4d-4dcd-a536-622e08c44ffb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:41.390967 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-297b39ee-1a4d-4dcd-a536-622e08c44ffb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:41.391745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-297b39ee-1a4d-4dcd-a536-622e08c44ffb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:41.392191 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-297b39ee-1a4d-4dcd-a536-622e08c44ffb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:41.458705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-297b39ee-1a4d-4dcd-a536-622e08c44ffb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:41.466270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-297b39ee-1a4d-4dcd-a536-622e08c44ffb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086812 May 26 13:28:41.466864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 975/1923] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:41 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:42.483775 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-83e3b1db-373c-42bc-844d-c1f6d7943142 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:42.484366 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-83e3b1db-373c-42bc-844d-c1f6d7943142 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:42.491158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83e3b1db-373c-42bc-844d-c1f6d7943142 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:42.491607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83e3b1db-373c-42bc-844d-c1f6d7943142 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:42.492372 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83e3b1db-373c-42bc-844d-c1f6d7943142 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:42.492817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83e3b1db-373c-42bc-844d-c1f6d7943142 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:42.558607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-83e3b1db-373c-42bc-844d-c1f6d7943142 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:42.567354 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-83e3b1db-373c-42bc-844d-c1f6d7943142 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086840 May 26 13:28:42.567937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 949/1924] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:42 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:43.584886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b0796c41-4849-44dd-8737-2ec701956d7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:43.585447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b0796c41-4849-44dd-8737-2ec701956d7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:43.592047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0796c41-4849-44dd-8737-2ec701956d7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:43.592492 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0796c41-4849-44dd-8737-2ec701956d7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:43.593255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0796c41-4849-44dd-8737-2ec701956d7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:43.593687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0796c41-4849-44dd-8737-2ec701956d7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:43.654839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b0796c41-4849-44dd-8737-2ec701956d7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:43.663319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b0796c41-4849-44dd-8737-2ec701956d7c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083079 May 26 13:28:43.663883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 976/1925] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:43 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:44.681060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-98a1e978-9822-483e-9edd-a970872c74ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:44.681681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-98a1e978-9822-483e-9edd-a970872c74ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:44.688546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98a1e978-9822-483e-9edd-a970872c74ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:44.688915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98a1e978-9822-483e-9edd-a970872c74ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:44.689703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98a1e978-9822-483e-9edd-a970872c74ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:44.690143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98a1e978-9822-483e-9edd-a970872c74ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:44.773431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-98a1e978-9822-483e-9edd-a970872c74ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:44.781195 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-98a1e978-9822-483e-9edd-a970872c74ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.104567 May 26 13:28:44.781774 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 950/1926] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:44 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:45.798839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-421085b4-8d42-41e6-a759-37c3e9a333ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:45.799460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-421085b4-8d42-41e6-a759-37c3e9a333ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:45.807019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-421085b4-8d42-41e6-a759-37c3e9a333ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:45.807475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-421085b4-8d42-41e6-a759-37c3e9a333ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:45.808246 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-421085b4-8d42-41e6-a759-37c3e9a333ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:45.808686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-421085b4-8d42-41e6-a759-37c3e9a333ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:45.873255 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-421085b4-8d42-41e6-a759-37c3e9a333ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:45.881641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-421085b4-8d42-41e6-a759-37c3e9a333ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086703 May 26 13:28:45.882227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 977/1927] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:45 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:46.898730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-058d2625-a26a-4662-a33f-dc26f241bb1a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:46.899382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-058d2625-a26a-4662-a33f-dc26f241bb1a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:46.906005 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-058d2625-a26a-4662-a33f-dc26f241bb1a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:46.906648 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-058d2625-a26a-4662-a33f-dc26f241bb1a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:46.907251 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-058d2625-a26a-4662-a33f-dc26f241bb1a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:46.907712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-058d2625-a26a-4662-a33f-dc26f241bb1a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:46.972797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-058d2625-a26a-4662-a33f-dc26f241bb1a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:46.981921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-058d2625-a26a-4662-a33f-dc26f241bb1a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087176 May 26 13:28:46.982495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 951/1928] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:46 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:47.999858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-212c59ff-a0e4-4055-81d8-5b488d4ba9b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:48.000475 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-212c59ff-a0e4-4055-81d8-5b488d4ba9b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:48.008140 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-212c59ff-a0e4-4055-81d8-5b488d4ba9b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:48.008597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-212c59ff-a0e4-4055-81d8-5b488d4ba9b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:48.009363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-212c59ff-a0e4-4055-81d8-5b488d4ba9b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:48.009805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-212c59ff-a0e4-4055-81d8-5b488d4ba9b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:48.072181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-212c59ff-a0e4-4055-81d8-5b488d4ba9b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:48.079871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-212c59ff-a0e4-4055-81d8-5b488d4ba9b9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083923 May 26 13:28:48.080450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 978/1929] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:47 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:49.097978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1dd702bd-bb8e-41b2-9e8a-b8c9dca57430 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:49.098606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1dd702bd-bb8e-41b2-9e8a-b8c9dca57430 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:49.105488 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1dd702bd-bb8e-41b2-9e8a-b8c9dca57430 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:49.105945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1dd702bd-bb8e-41b2-9e8a-b8c9dca57430 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:49.106767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1dd702bd-bb8e-41b2-9e8a-b8c9dca57430 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:49.107208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1dd702bd-bb8e-41b2-9e8a-b8c9dca57430 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:49.171760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1dd702bd-bb8e-41b2-9e8a-b8c9dca57430 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:49.180140 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1dd702bd-bb8e-41b2-9e8a-b8c9dca57430 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086684 May 26 13:28:49.180716 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 952/1930] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:49 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:50.197847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef8f9dd9-112c-44c5-b93a-bc06f8c01d4e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:50.198491 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef8f9dd9-112c-44c5-b93a-bc06f8c01d4e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:50.205409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef8f9dd9-112c-44c5-b93a-bc06f8c01d4e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:50.205864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef8f9dd9-112c-44c5-b93a-bc06f8c01d4e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:50.206736 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef8f9dd9-112c-44c5-b93a-bc06f8c01d4e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:50.207243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef8f9dd9-112c-44c5-b93a-bc06f8c01d4e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:50.284078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef8f9dd9-112c-44c5-b93a-bc06f8c01d4e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:50.292999 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef8f9dd9-112c-44c5-b93a-bc06f8c01d4e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.099428 May 26 13:28:50.293576 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 979/1931] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:50 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:28:51.310845 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4cf1e875-1def-4541-a00a-7a0bca197a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:51.311458 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4cf1e875-1def-4541-a00a-7a0bca197a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:51.318512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cf1e875-1def-4541-a00a-7a0bca197a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:51.318989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cf1e875-1def-4541-a00a-7a0bca197a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:51.319758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cf1e875-1def-4541-a00a-7a0bca197a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:51.320199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cf1e875-1def-4541-a00a-7a0bca197a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:51.385401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4cf1e875-1def-4541-a00a-7a0bca197a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:51.393196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4cf1e875-1def-4541-a00a-7a0bca197a97 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086163 May 26 13:28:51.393797 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 953/1932] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:51 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:52.412391 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e943ac6-ae7f-43ad-ab4e-91e8bf6cb250 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:52.412990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e943ac6-ae7f-43ad-ab4e-91e8bf6cb250 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:52.420561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e943ac6-ae7f-43ad-ab4e-91e8bf6cb250 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:52.421009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e943ac6-ae7f-43ad-ab4e-91e8bf6cb250 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:52.421778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e943ac6-ae7f-43ad-ab4e-91e8bf6cb250 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:52.422217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e943ac6-ae7f-43ad-ab4e-91e8bf6cb250 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:52.484273 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e943ac6-ae7f-43ad-ab4e-91e8bf6cb250 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:52.491926 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e943ac6-ae7f-43ad-ab4e-91e8bf6cb250 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085297 May 26 13:28:52.492493 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 980/1933] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:52 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:53.508869 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-caec54aa-d708-47a1-8ad5-b514c0699336 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:53.509509 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-caec54aa-d708-47a1-8ad5-b514c0699336 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:53.516060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-caec54aa-d708-47a1-8ad5-b514c0699336 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:53.516512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-caec54aa-d708-47a1-8ad5-b514c0699336 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:53.517266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-caec54aa-d708-47a1-8ad5-b514c0699336 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:53.517703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-caec54aa-d708-47a1-8ad5-b514c0699336 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:53.586789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-caec54aa-d708-47a1-8ad5-b514c0699336 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:53.594584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-caec54aa-d708-47a1-8ad5-b514c0699336 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089778 May 26 13:28:53.595149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 954/1934] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:53 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:54.612328 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab6f958f-aca1-47fa-89c0-6f352f53589b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:54.612952 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab6f958f-aca1-47fa-89c0-6f352f53589b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:54.619985 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab6f958f-aca1-47fa-89c0-6f352f53589b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:54.620435 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab6f958f-aca1-47fa-89c0-6f352f53589b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:54.621194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab6f958f-aca1-47fa-89c0-6f352f53589b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:54.621630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab6f958f-aca1-47fa-89c0-6f352f53589b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:54.683887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab6f958f-aca1-47fa-89c0-6f352f53589b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:54.691469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab6f958f-aca1-47fa-89c0-6f352f53589b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083107 May 26 13:28:54.692324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 981/1935] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:54 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:55.708523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8671a613-4891-497a-b4ad-c5da70c53c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:55.709151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8671a613-4891-497a-b4ad-c5da70c53c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:55.715626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8671a613-4891-497a-b4ad-c5da70c53c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:55.716077 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8671a613-4891-497a-b4ad-c5da70c53c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:55.716833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8671a613-4891-497a-b4ad-c5da70c53c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:55.717268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8671a613-4891-497a-b4ad-c5da70c53c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:55.778236 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8671a613-4891-497a-b4ad-c5da70c53c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:55.785844 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8671a613-4891-497a-b4ad-c5da70c53c5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081108 May 26 13:28:55.786401 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 955/1936] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:55 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:56.802794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-272cd185-bfe5-42d4-aa2f-e7463c18ceeb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:56.803389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-272cd185-bfe5-42d4-aa2f-e7463c18ceeb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:56.809880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-272cd185-bfe5-42d4-aa2f-e7463c18ceeb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:56.810330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-272cd185-bfe5-42d4-aa2f-e7463c18ceeb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:56.811130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-272cd185-bfe5-42d4-aa2f-e7463c18ceeb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:56.811564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-272cd185-bfe5-42d4-aa2f-e7463c18ceeb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:56.883917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-272cd185-bfe5-42d4-aa2f-e7463c18ceeb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:56.893854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-272cd185-bfe5-42d4-aa2f-e7463c18ceeb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.094636 May 26 13:28:56.895217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 982/1937] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:56 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:57.912276 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-efb59165-7e54-4490-ab71-f9731b49ee6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:57.912907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-efb59165-7e54-4490-ab71-f9731b49ee6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:57.919348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efb59165-7e54-4490-ab71-f9731b49ee6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:57.919793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efb59165-7e54-4490-ab71-f9731b49ee6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:57.920552 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efb59165-7e54-4490-ab71-f9731b49ee6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:57.920990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efb59165-7e54-4490-ab71-f9731b49ee6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:57.981868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-efb59165-7e54-4490-ab71-f9731b49ee6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:57.990451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-efb59165-7e54-4490-ab71-f9731b49ee6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082378 May 26 13:28:57.991011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 956/1938] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:57 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:28:59.007225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c38b852f-c116-450a-bce5-6515ec21804c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:28:59.007832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c38b852f-c116-450a-bce5-6515ec21804c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:28:59.014298 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c38b852f-c116-450a-bce5-6515ec21804c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:59.014787 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c38b852f-c116-450a-bce5-6515ec21804c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:59.015550 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c38b852f-c116-450a-bce5-6515ec21804c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:28:59.015986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c38b852f-c116-450a-bce5-6515ec21804c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:28:59.079222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c38b852f-c116-450a-bce5-6515ec21804c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:28:59.086816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c38b852f-c116-450a-bce5-6515ec21804c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083583 May 26 13:28:59.087387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 983/1939] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:28:59 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:00.104673 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c31c8806-a81f-4abf-91a0-5ab7f2623406 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:00.105263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c31c8806-a81f-4abf-91a0-5ab7f2623406 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:00.112129 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c31c8806-a81f-4abf-91a0-5ab7f2623406 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:00.114966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c31c8806-a81f-4abf-91a0-5ab7f2623406 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:00.114966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c31c8806-a81f-4abf-91a0-5ab7f2623406 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:00.114966 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c31c8806-a81f-4abf-91a0-5ab7f2623406 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:00.179584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c31c8806-a81f-4abf-91a0-5ab7f2623406 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:00.187036 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c31c8806-a81f-4abf-91a0-5ab7f2623406 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087162 May 26 13:29:00.187605 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 957/1940] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:00 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:01.204300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2807f40-f5d4-4076-90b2-d92708aec593 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:01.204908 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2807f40-f5d4-4076-90b2-d92708aec593 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:01.211548 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2807f40-f5d4-4076-90b2-d92708aec593 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:01.212111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2807f40-f5d4-4076-90b2-d92708aec593 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:01.212873 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2807f40-f5d4-4076-90b2-d92708aec593 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:01.213310 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2807f40-f5d4-4076-90b2-d92708aec593 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:01.276710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f2807f40-f5d4-4076-90b2-d92708aec593 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:01.284283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2807f40-f5d4-4076-90b2-d92708aec593 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083924 May 26 13:29:01.284847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 984/1941] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:01 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:02.301182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f488fc59-f58d-4298-9659-d6127132d770 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:02.301811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f488fc59-f58d-4298-9659-d6127132d770 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:02.309109 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f488fc59-f58d-4298-9659-d6127132d770 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:02.309572 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f488fc59-f58d-4298-9659-d6127132d770 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:02.310347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f488fc59-f58d-4298-9659-d6127132d770 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:02.310826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f488fc59-f58d-4298-9659-d6127132d770 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:02.371691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f488fc59-f58d-4298-9659-d6127132d770 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:02.379243 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f488fc59-f58d-4298-9659-d6127132d770 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081953 May 26 13:29:02.379811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 958/1942] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:02 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:03.395702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af2386c1-cb87-4f7e-9975-1b8d4eb4018c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:03.396825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af2386c1-cb87-4f7e-9975-1b8d4eb4018c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:03.399222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:03.404123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af2386c1-cb87-4f7e-9975-1b8d4eb4018c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:03.404580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af2386c1-cb87-4f7e-9975-1b8d4eb4018c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:03.405361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af2386c1-cb87-4f7e-9975-1b8d4eb4018c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:03.405799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af2386c1-cb87-4f7e-9975-1b8d4eb4018c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:03.408596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:03.468217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af2386c1-cb87-4f7e-9975-1b8d4eb4018c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:03.476401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af2386c1-cb87-4f7e-9975-1b8d4eb4018c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084591 May 26 13:29:03.476995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 985/1943] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:03 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:29:04.493199 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8455fed6-d5c1-4a88-81e9-991033144f6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:04.493801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8455fed6-d5c1-4a88-81e9-991033144f6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:04.496779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:04.501532 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8455fed6-d5c1-4a88-81e9-991033144f6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:04.501990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8455fed6-d5c1-4a88-81e9-991033144f6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:04.502788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8455fed6-d5c1-4a88-81e9-991033144f6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:04.503231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8455fed6-d5c1-4a88-81e9-991033144f6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:04.564322 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8455fed6-d5c1-4a88-81e9-991033144f6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:04.571795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8455fed6-d5c1-4a88-81e9-991033144f6f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082384 May 26 13:29:04.572366 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 959/1944] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:04 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:05.590681 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ec0cdf6-6159-4342-9991-8d1229186d89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:05.591240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ec0cdf6-6159-4342-9991-8d1229186d89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:05.597866 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ec0cdf6-6159-4342-9991-8d1229186d89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:05.598316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ec0cdf6-6159-4342-9991-8d1229186d89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:05.599118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ec0cdf6-6159-4342-9991-8d1229186d89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:05.599560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ec0cdf6-6159-4342-9991-8d1229186d89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:05.660131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ec0cdf6-6159-4342-9991-8d1229186d89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:05.667694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ec0cdf6-6159-4342-9991-8d1229186d89 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082510 May 26 13:29:05.668274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 986/1945] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:05 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:06.684958 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c584b3a-8e62-4cf6-8feb-d04d833acdc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:06.685594 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c584b3a-8e62-4cf6-8feb-d04d833acdc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:06.692076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c584b3a-8e62-4cf6-8feb-d04d833acdc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:06.692526 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c584b3a-8e62-4cf6-8feb-d04d833acdc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:06.693287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c584b3a-8e62-4cf6-8feb-d04d833acdc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:06.693720 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c584b3a-8e62-4cf6-8feb-d04d833acdc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:06.696234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:06.756938 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c584b3a-8e62-4cf6-8feb-d04d833acdc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:06.764854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c584b3a-8e62-4cf6-8feb-d04d833acdc4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083794 May 26 13:29:06.765417 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 960/1946] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:06 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:07.782421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49d1dde4-0653-4a02-8be7-538fbccc731f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:07.783077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49d1dde4-0653-4a02-8be7-538fbccc731f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:07.791503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49d1dde4-0653-4a02-8be7-538fbccc731f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:07.791953 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49d1dde4-0653-4a02-8be7-538fbccc731f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:07.792739 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49d1dde4-0653-4a02-8be7-538fbccc731f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:07.793179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49d1dde4-0653-4a02-8be7-538fbccc731f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:07.862406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49d1dde4-0653-4a02-8be7-538fbccc731f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:07.870677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49d1dde4-0653-4a02-8be7-538fbccc731f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092037 May 26 13:29:07.871154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 987/1947] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:07 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:29:08.887207 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce6a3f73-d551-48e2-95c9-3c5ad7d6198c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:08.887770 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce6a3f73-d551-48e2-95c9-3c5ad7d6198c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:08.894200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce6a3f73-d551-48e2-95c9-3c5ad7d6198c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:08.894691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce6a3f73-d551-48e2-95c9-3c5ad7d6198c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:08.895454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce6a3f73-d551-48e2-95c9-3c5ad7d6198c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:08.895891 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce6a3f73-d551-48e2-95c9-3c5ad7d6198c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:08.962779 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce6a3f73-d551-48e2-95c9-3c5ad7d6198c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:08.970454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce6a3f73-d551-48e2-95c9-3c5ad7d6198c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087810 May 26 13:29:08.971118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 961/1948] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:08 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:09.989119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e38537b8-ab6b-410d-b6a0-e969dca7e2f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:09.991221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e38537b8-ab6b-410d-b6a0-e969dca7e2f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:09.996943 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e38537b8-ab6b-410d-b6a0-e969dca7e2f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:09.997265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e38537b8-ab6b-410d-b6a0-e969dca7e2f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:09.998162 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e38537b8-ab6b-410d-b6a0-e969dca7e2f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:09.998512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e38537b8-ab6b-410d-b6a0-e969dca7e2f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:10.061160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e38537b8-ab6b-410d-b6a0-e969dca7e2f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:10.069022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e38537b8-ab6b-410d-b6a0-e969dca7e2f3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083965 May 26 13:29:10.069604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 988/1949] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:09 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:29:11.085545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56345a0d-d26e-4992-8e7c-eb415815aef0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:11.086150 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56345a0d-d26e-4992-8e7c-eb415815aef0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:11.093485 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56345a0d-d26e-4992-8e7c-eb415815aef0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:11.093937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56345a0d-d26e-4992-8e7c-eb415815aef0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:11.094744 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56345a0d-d26e-4992-8e7c-eb415815aef0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:11.095184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56345a0d-d26e-4992-8e7c-eb415815aef0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:11.155099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56345a0d-d26e-4992-8e7c-eb415815aef0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:11.162567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56345a0d-d26e-4992-8e7c-eb415815aef0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080979 May 26 13:29:11.163125 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 962/1950] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:11 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:12.179937 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f801d48-adaf-438d-9621-15f81280073b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:12.180588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f801d48-adaf-438d-9621-15f81280073b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:12.187460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f801d48-adaf-438d-9621-15f81280073b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:12.187936 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f801d48-adaf-438d-9621-15f81280073b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:12.188751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f801d48-adaf-438d-9621-15f81280073b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:12.189822 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f801d48-adaf-438d-9621-15f81280073b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:12.258123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f801d48-adaf-438d-9621-15f81280073b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:12.267283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f801d48-adaf-438d-9621-15f81280073b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.091192 May 26 13:29:12.267857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 989/1951] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:12 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:13.284900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbc8fc6b-76ff-4525-bbde-bd4d11a873ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:13.285522 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbc8fc6b-76ff-4525-bbde-bd4d11a873ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:13.292045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbc8fc6b-76ff-4525-bbde-bd4d11a873ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:13.292500 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbc8fc6b-76ff-4525-bbde-bd4d11a873ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:13.293269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbc8fc6b-76ff-4525-bbde-bd4d11a873ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:13.293715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbc8fc6b-76ff-4525-bbde-bd4d11a873ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:13.358765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbc8fc6b-76ff-4525-bbde-bd4d11a873ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:13.366299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbc8fc6b-76ff-4525-bbde-bd4d11a873ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085386 May 26 13:29:13.366906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 963/1952] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:13 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:14.385429 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89445edd-3e1a-401c-bb21-a41e44241fda tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:14.386047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-89445edd-3e1a-401c-bb21-a41e44241fda tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:14.394496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89445edd-3e1a-401c-bb21-a41e44241fda tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:14.394979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89445edd-3e1a-401c-bb21-a41e44241fda tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:14.395758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89445edd-3e1a-401c-bb21-a41e44241fda tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:14.402311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89445edd-3e1a-401c-bb21-a41e44241fda tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:14.459307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-89445edd-3e1a-401c-bb21-a41e44241fda tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:14.467160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-89445edd-3e1a-401c-bb21-a41e44241fda tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085382 May 26 13:29:14.467737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 990/1953] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:14 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:15.484299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c18a65e0-95c3-47ee-a7ef-4eb7d533d0d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:15.484910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c18a65e0-95c3-47ee-a7ef-4eb7d533d0d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:15.491632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c18a65e0-95c3-47ee-a7ef-4eb7d533d0d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:15.492086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c18a65e0-95c3-47ee-a7ef-4eb7d533d0d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:15.492857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c18a65e0-95c3-47ee-a7ef-4eb7d533d0d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:15.493297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c18a65e0-95c3-47ee-a7ef-4eb7d533d0d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:15.553626 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c18a65e0-95c3-47ee-a7ef-4eb7d533d0d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:15.561103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c18a65e0-95c3-47ee-a7ef-4eb7d533d0d1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080779 May 26 13:29:15.561656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 964/1954] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:15 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:16.578173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1d6247f-cf41-4aaa-9175-4f9acce74639 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:16.578781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1d6247f-cf41-4aaa-9175-4f9acce74639 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:16.585321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d6247f-cf41-4aaa-9175-4f9acce74639 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:16.585773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d6247f-cf41-4aaa-9175-4f9acce74639 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:16.586555 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d6247f-cf41-4aaa-9175-4f9acce74639 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:16.586997 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d6247f-cf41-4aaa-9175-4f9acce74639 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:16.650734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1d6247f-cf41-4aaa-9175-4f9acce74639 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:16.658693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1d6247f-cf41-4aaa-9175-4f9acce74639 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084731 May 26 13:29:16.659259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 991/1955] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:16 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:17.675529 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d645355-6858-4e06-bc6c-d4527f4e8938 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:17.676139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d645355-6858-4e06-bc6c-d4527f4e8938 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:17.682490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d645355-6858-4e06-bc6c-d4527f4e8938 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:17.682985 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d645355-6858-4e06-bc6c-d4527f4e8938 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:17.683752 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d645355-6858-4e06-bc6c-d4527f4e8938 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:17.684188 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d645355-6858-4e06-bc6c-d4527f4e8938 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:17.750668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d645355-6858-4e06-bc6c-d4527f4e8938 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:17.758270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d645355-6858-4e06-bc6c-d4527f4e8938 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086581 May 26 13:29:17.759078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 965/1956] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:17 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:18.032285 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:29:18.032460 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:29:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:29:18.775978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c419234f-7dbb-46f3-a2d9-a6e5672a60e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:18.776589 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c419234f-7dbb-46f3-a2d9-a6e5672a60e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:18.783781 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c419234f-7dbb-46f3-a2d9-a6e5672a60e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:18.784232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c419234f-7dbb-46f3-a2d9-a6e5672a60e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:18.784994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c419234f-7dbb-46f3-a2d9-a6e5672a60e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:18.785431 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c419234f-7dbb-46f3-a2d9-a6e5672a60e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:18.845715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c419234f-7dbb-46f3-a2d9-a6e5672a60e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:18.853383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c419234f-7dbb-46f3-a2d9-a6e5672a60e2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081328 May 26 13:29:18.853945 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 992/1957] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:18 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:19.869896 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d048de40-6cdc-4652-9df3-b00419dec6ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:19.870567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d048de40-6cdc-4652-9df3-b00419dec6ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:19.877473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d048de40-6cdc-4652-9df3-b00419dec6ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:19.877935 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d048de40-6cdc-4652-9df3-b00419dec6ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:19.878742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d048de40-6cdc-4652-9df3-b00419dec6ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:19.879189 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d048de40-6cdc-4652-9df3-b00419dec6ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:19.941865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d048de40-6cdc-4652-9df3-b00419dec6ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:19.949384 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d048de40-6cdc-4652-9df3-b00419dec6ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083369 May 26 13:29:19.949946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 966/1958] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:19 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:20.965218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3941a181-e9e4-441a-a4fc-fbcdd4f51c0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:20.965828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3941a181-e9e4-441a-a4fc-fbcdd4f51c0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:20.972714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3941a181-e9e4-441a-a4fc-fbcdd4f51c0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:20.973266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3941a181-e9e4-441a-a4fc-fbcdd4f51c0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:20.974035 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3941a181-e9e4-441a-a4fc-fbcdd4f51c0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:20.974478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3941a181-e9e4-441a-a4fc-fbcdd4f51c0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:21.036058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3941a181-e9e4-441a-a4fc-fbcdd4f51c0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:21.043587 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3941a181-e9e4-441a-a4fc-fbcdd4f51c0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082283 May 26 13:29:21.044149 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 993/1959] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:20 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:22.060860 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a561515e-4dd0-43c2-8a9c-a48add32af20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:22.061535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a561515e-4dd0-43c2-8a9c-a48add32af20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:22.069108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a561515e-4dd0-43c2-8a9c-a48add32af20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:22.069562 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a561515e-4dd0-43c2-8a9c-a48add32af20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:22.070342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a561515e-4dd0-43c2-8a9c-a48add32af20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:22.070810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a561515e-4dd0-43c2-8a9c-a48add32af20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:22.133587 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a561515e-4dd0-43c2-8a9c-a48add32af20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:22.142197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a561515e-4dd0-43c2-8a9c-a48add32af20 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085150 May 26 13:29:22.142821 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 967/1960] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:22 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:23.163419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-881847e7-cbc6-4d29-bc59-252d596371de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:23.164037 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-881847e7-cbc6-4d29-bc59-252d596371de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:23.173295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-881847e7-cbc6-4d29-bc59-252d596371de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:23.173749 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-881847e7-cbc6-4d29-bc59-252d596371de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:23.174599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-881847e7-cbc6-4d29-bc59-252d596371de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:23.174991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-881847e7-cbc6-4d29-bc59-252d596371de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:23.237235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-881847e7-cbc6-4d29-bc59-252d596371de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:23.244772 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-881847e7-cbc6-4d29-bc59-252d596371de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087467 May 26 13:29:23.245334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 994/1961] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:23 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:24.264639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-30ac8ab6-a6e1-4164-93aa-99432be46500 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:24.266690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-30ac8ab6-a6e1-4164-93aa-99432be46500 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:24.274482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30ac8ab6-a6e1-4164-93aa-99432be46500 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:24.275070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30ac8ab6-a6e1-4164-93aa-99432be46500 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:24.276037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30ac8ab6-a6e1-4164-93aa-99432be46500 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:24.276523 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30ac8ab6-a6e1-4164-93aa-99432be46500 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:24.341431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-30ac8ab6-a6e1-4164-93aa-99432be46500 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:24.350229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-30ac8ab6-a6e1-4164-93aa-99432be46500 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090779 May 26 13:29:24.350829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 968/1962] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:24 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:24.981885 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:29:24.982171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:29:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:29:25.368041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c0e29f8a-b958-412d-ab06-8ace264c575c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:25.368641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c0e29f8a-b958-412d-ab06-8ace264c575c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:25.375821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e29f8a-b958-412d-ab06-8ace264c575c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:25.376269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e29f8a-b958-412d-ab06-8ace264c575c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:25.377026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e29f8a-b958-412d-ab06-8ace264c575c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:25.377460 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e29f8a-b958-412d-ab06-8ace264c575c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:25.445185 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0e29f8a-b958-412d-ab06-8ace264c575c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:25.454271 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c0e29f8a-b958-412d-ab06-8ace264c575c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089961 May 26 13:29:25.454957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 995/1963] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:25 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:26.472977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-add94832-2809-49d4-91c5-cfe7e5e82872 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:26.473617 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-add94832-2809-49d4-91c5-cfe7e5e82872 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:26.480619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-add94832-2809-49d4-91c5-cfe7e5e82872 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:26.481067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-add94832-2809-49d4-91c5-cfe7e5e82872 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:26.481829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-add94832-2809-49d4-91c5-cfe7e5e82872 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:26.482265 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-add94832-2809-49d4-91c5-cfe7e5e82872 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:26.546102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-add94832-2809-49d4-91c5-cfe7e5e82872 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:26.553646 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-add94832-2809-49d4-91c5-cfe7e5e82872 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085437 May 26 13:29:26.554197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 969/1964] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:26 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:29:27.571244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b290648-57c4-41f6-823f-7eef17241ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:27.571841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b290648-57c4-41f6-823f-7eef17241ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:27.578920 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b290648-57c4-41f6-823f-7eef17241ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:27.579368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b290648-57c4-41f6-823f-7eef17241ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:27.580164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b290648-57c4-41f6-823f-7eef17241ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:27.580598 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b290648-57c4-41f6-823f-7eef17241ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:27.642998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b290648-57c4-41f6-823f-7eef17241ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:27.650836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b290648-57c4-41f6-823f-7eef17241ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083987 May 26 13:29:27.651421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 996/1965] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:27 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:28.668168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-78e36f83-63f7-4c3b-b7ac-175c4b18b70e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:28.668780 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-78e36f83-63f7-4c3b-b7ac-175c4b18b70e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:28.678419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78e36f83-63f7-4c3b-b7ac-175c4b18b70e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:28.678932 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78e36f83-63f7-4c3b-b7ac-175c4b18b70e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:28.679717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78e36f83-63f7-4c3b-b7ac-175c4b18b70e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:28.680161 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78e36f83-63f7-4c3b-b7ac-175c4b18b70e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:28.744619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78e36f83-63f7-4c3b-b7ac-175c4b18b70e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:28.752424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-78e36f83-63f7-4c3b-b7ac-175c4b18b70e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088188 May 26 13:29:28.753020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 970/1966] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:28 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:29.770403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d443f225-2b20-478a-9c95-0c827d593b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:29.771038 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d443f225-2b20-478a-9c95-0c827d593b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:29.777580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d443f225-2b20-478a-9c95-0c827d593b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:29.778034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d443f225-2b20-478a-9c95-0c827d593b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:29.778838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d443f225-2b20-478a-9c95-0c827d593b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:29.779281 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d443f225-2b20-478a-9c95-0c827d593b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:29.840696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d443f225-2b20-478a-9c95-0c827d593b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:29.849024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d443f225-2b20-478a-9c95-0c827d593b14 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082486 May 26 13:29:29.849596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 997/1967] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:29 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:30.866078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-802b6247-67da-4fcb-adb6-feb27bc3e402 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:30.866717 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-802b6247-67da-4fcb-adb6-feb27bc3e402 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:30.873416 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-802b6247-67da-4fcb-adb6-feb27bc3e402 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:30.873870 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-802b6247-67da-4fcb-adb6-feb27bc3e402 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:30.874727 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-802b6247-67da-4fcb-adb6-feb27bc3e402 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:30.875172 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-802b6247-67da-4fcb-adb6-feb27bc3e402 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:30.936382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-802b6247-67da-4fcb-adb6-feb27bc3e402 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:30.943939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-802b6247-67da-4fcb-adb6-feb27bc3e402 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081722 May 26 13:29:30.944504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 971/1968] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:30 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:31.960864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1dadc043-d7bc-4edc-9dea-86bf88b2eceb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:31.961470 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1dadc043-d7bc-4edc-9dea-86bf88b2eceb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:31.967979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dadc043-d7bc-4edc-9dea-86bf88b2eceb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:31.969287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dadc043-d7bc-4edc-9dea-86bf88b2eceb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:31.970178 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dadc043-d7bc-4edc-9dea-86bf88b2eceb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:31.970650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dadc043-d7bc-4edc-9dea-86bf88b2eceb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:32.034515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dadc043-d7bc-4edc-9dea-86bf88b2eceb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:32.042067 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1dadc043-d7bc-4edc-9dea-86bf88b2eceb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085124 May 26 13:29:32.042715 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 998/1969] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:31 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:29:33.059004 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-053a9ba5-3f7e-4c1f-8a8b-346953301667 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:33.059560 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-053a9ba5-3f7e-4c1f-8a8b-346953301667 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:33.067589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-053a9ba5-3f7e-4c1f-8a8b-346953301667 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:33.068045 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-053a9ba5-3f7e-4c1f-8a8b-346953301667 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:33.068826 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-053a9ba5-3f7e-4c1f-8a8b-346953301667 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:33.069269 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-053a9ba5-3f7e-4c1f-8a8b-346953301667 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:33.133513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-053a9ba5-3f7e-4c1f-8a8b-346953301667 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:33.144096 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-053a9ba5-3f7e-4c1f-8a8b-346953301667 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088922 May 26 13:29:33.144657 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 972/1970] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:33 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:34.162958 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-135c7b47-c68e-47a4-a48c-5f41771c9e3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:34.163572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-135c7b47-c68e-47a4-a48c-5f41771c9e3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:34.165899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:34.170796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-135c7b47-c68e-47a4-a48c-5f41771c9e3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:34.171363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-135c7b47-c68e-47a4-a48c-5f41771c9e3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:34.172245 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-135c7b47-c68e-47a4-a48c-5f41771c9e3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:34.172690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-135c7b47-c68e-47a4-a48c-5f41771c9e3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:34.237547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-135c7b47-c68e-47a4-a48c-5f41771c9e3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:34.245073 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-135c7b47-c68e-47a4-a48c-5f41771c9e3c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086025 May 26 13:29:34.245634 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 999/1971] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:34 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:35.261883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31c94dbd-7bab-4372-b00a-082f068300c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:35.262504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31c94dbd-7bab-4372-b00a-082f068300c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:35.264915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:35.269874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31c94dbd-7bab-4372-b00a-082f068300c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:35.274501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31c94dbd-7bab-4372-b00a-082f068300c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:35.274501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31c94dbd-7bab-4372-b00a-082f068300c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:35.274501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31c94dbd-7bab-4372-b00a-082f068300c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:35.336738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31c94dbd-7bab-4372-b00a-082f068300c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:35.345197 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31c94dbd-7bab-4372-b00a-082f068300c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087260 May 26 13:29:35.345756 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 973/1972] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:35 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:36.362512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7890309c-b382-4c30-b149-bbbd2497f682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:36.363156 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7890309c-b382-4c30-b149-bbbd2497f682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:36.369631 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7890309c-b382-4c30-b149-bbbd2497f682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:36.370088 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7890309c-b382-4c30-b149-bbbd2497f682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:36.370895 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7890309c-b382-4c30-b149-bbbd2497f682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:36.371343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7890309c-b382-4c30-b149-bbbd2497f682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:36.375467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=90 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:36.432630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7890309c-b382-4c30-b149-bbbd2497f682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:36.440361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7890309c-b382-4c30-b149-bbbd2497f682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082209 May 26 13:29:36.440919 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1000/1973] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:36 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:37.457247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fbb72739-0eaf-4623-99fe-bd8b11a2bcc5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:37.457838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fbb72739-0eaf-4623-99fe-bd8b11a2bcc5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:37.464369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbb72739-0eaf-4623-99fe-bd8b11a2bcc5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:37.464819 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbb72739-0eaf-4623-99fe-bd8b11a2bcc5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:37.465578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbb72739-0eaf-4623-99fe-bd8b11a2bcc5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:37.466014 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbb72739-0eaf-4623-99fe-bd8b11a2bcc5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:37.469102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:37.535466 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fbb72739-0eaf-4623-99fe-bd8b11a2bcc5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:37.543495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fbb72739-0eaf-4623-99fe-bd8b11a2bcc5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090111 May 26 13:29:37.544063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 974/1974] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:37 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:38.561056 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-96398e9f-19af-4561-9c86-3cf2fcae4b61 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:38.561640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-96398e9f-19af-4561-9c86-3cf2fcae4b61 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:38.568264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96398e9f-19af-4561-9c86-3cf2fcae4b61 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:38.568712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96398e9f-19af-4561-9c86-3cf2fcae4b61 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:38.569468 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96398e9f-19af-4561-9c86-3cf2fcae4b61 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:38.569901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96398e9f-19af-4561-9c86-3cf2fcae4b61 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:38.631379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-96398e9f-19af-4561-9c86-3cf2fcae4b61 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:38.638252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-96398e9f-19af-4561-9c86-3cf2fcae4b61 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081123 May 26 13:29:38.638869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1001/1975] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:38 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:39.659164 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-402d4ec9-530e-452d-b9c6-68ebf0d37b1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:39.660070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-402d4ec9-530e-452d-b9c6-68ebf0d37b1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:39.669241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-402d4ec9-530e-452d-b9c6-68ebf0d37b1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:39.669862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-402d4ec9-530e-452d-b9c6-68ebf0d37b1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:39.670977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-402d4ec9-530e-452d-b9c6-68ebf0d37b1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:39.672113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-402d4ec9-530e-452d-b9c6-68ebf0d37b1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:39.732931 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-402d4ec9-530e-452d-b9c6-68ebf0d37b1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:39.741425 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-402d4ec9-530e-452d-b9c6-68ebf0d37b1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089739 May 26 13:29:39.741986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 975/1976] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:39 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:40.758258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fc2e560f-7131-4ca6-b372-aa885a36c3a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:40.758932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fc2e560f-7131-4ca6-b372-aa885a36c3a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:40.765430 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc2e560f-7131-4ca6-b372-aa885a36c3a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:40.765881 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc2e560f-7131-4ca6-b372-aa885a36c3a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:40.766677 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc2e560f-7131-4ca6-b372-aa885a36c3a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:40.767112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc2e560f-7131-4ca6-b372-aa885a36c3a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:40.830316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fc2e560f-7131-4ca6-b372-aa885a36c3a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:40.840251 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fc2e560f-7131-4ca6-b372-aa885a36c3a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085674 May 26 13:29:40.840994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1002/1977] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:40 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:41.860671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7bf5f1f3-9af2-48a8-a423-106fa60ea263 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:41.861273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7bf5f1f3-9af2-48a8-a423-106fa60ea263 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:41.867889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bf5f1f3-9af2-48a8-a423-106fa60ea263 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:41.868357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bf5f1f3-9af2-48a8-a423-106fa60ea263 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:41.869112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bf5f1f3-9af2-48a8-a423-106fa60ea263 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:41.869549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bf5f1f3-9af2-48a8-a423-106fa60ea263 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:41.935007 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7bf5f1f3-9af2-48a8-a423-106fa60ea263 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:41.943232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7bf5f1f3-9af2-48a8-a423-106fa60ea263 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086701 May 26 13:29:41.943801 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 976/1978] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:41 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:42.961166 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-871d44f2-dad3-4383-bd03-a3e62244c91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:42.961816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-871d44f2-dad3-4383-bd03-a3e62244c91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:42.969068 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871d44f2-dad3-4383-bd03-a3e62244c91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:42.969617 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871d44f2-dad3-4383-bd03-a3e62244c91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:42.970413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871d44f2-dad3-4383-bd03-a3e62244c91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:42.970884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871d44f2-dad3-4383-bd03-a3e62244c91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:43.035179 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-871d44f2-dad3-4383-bd03-a3e62244c91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:43.042751 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-871d44f2-dad3-4383-bd03-a3e62244c91b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085402 May 26 13:29:43.043323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1003/1979] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:42 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:43.447900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:29:43.448118 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:29:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:29:44.060333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04919f8b-75dc-49cd-9a27-af54c898a993 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:44.060952 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04919f8b-75dc-49cd-9a27-af54c898a993 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:44.068305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04919f8b-75dc-49cd-9a27-af54c898a993 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:44.068759 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04919f8b-75dc-49cd-9a27-af54c898a993 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:44.069535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04919f8b-75dc-49cd-9a27-af54c898a993 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:44.069975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04919f8b-75dc-49cd-9a27-af54c898a993 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:44.133367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04919f8b-75dc-49cd-9a27-af54c898a993 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:44.141297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04919f8b-75dc-49cd-9a27-af54c898a993 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084732 May 26 13:29:44.141854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 977/1980] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:44 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:45.158839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed2e72e0-2158-4881-8663-90842dacc6bc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:45.159478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed2e72e0-2158-4881-8663-90842dacc6bc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:45.166309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed2e72e0-2158-4881-8663-90842dacc6bc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:45.166797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed2e72e0-2158-4881-8663-90842dacc6bc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:45.167613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed2e72e0-2158-4881-8663-90842dacc6bc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:45.168054 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed2e72e0-2158-4881-8663-90842dacc6bc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:45.239163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed2e72e0-2158-4881-8663-90842dacc6bc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:45.246812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed2e72e0-2158-4881-8663-90842dacc6bc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092609 May 26 13:29:45.247393 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1004/1981] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:45 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:46.272305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-98ad69df-bd6f-4710-8ebb-59eab23ebb9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:46.272944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-98ad69df-bd6f-4710-8ebb-59eab23ebb9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:46.279366 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98ad69df-bd6f-4710-8ebb-59eab23ebb9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:46.279827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98ad69df-bd6f-4710-8ebb-59eab23ebb9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:46.281085 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98ad69df-bd6f-4710-8ebb-59eab23ebb9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:46.282061 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98ad69df-bd6f-4710-8ebb-59eab23ebb9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:46.342767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-98ad69df-bd6f-4710-8ebb-59eab23ebb9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:46.351142 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-98ad69df-bd6f-4710-8ebb-59eab23ebb9b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082862 May 26 13:29:46.351707 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 978/1982] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:46 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:47.367551 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9f0a802-7c75-4ca8-bd3c-232c84d1cc5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:47.368164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9f0a802-7c75-4ca8-bd3c-232c84d1cc5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:47.375000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9f0a802-7c75-4ca8-bd3c-232c84d1cc5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:47.375626 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9f0a802-7c75-4ca8-bd3c-232c84d1cc5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:47.376334 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9f0a802-7c75-4ca8-bd3c-232c84d1cc5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:47.376770 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9f0a802-7c75-4ca8-bd3c-232c84d1cc5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:47.438435 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9f0a802-7c75-4ca8-bd3c-232c84d1cc5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:47.445967 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9f0a802-7c75-4ca8-bd3c-232c84d1cc5b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082339 May 26 13:29:47.446543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1005/1983] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:47 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:48.462388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cfd4fa45-c3f6-4755-b507-701501fe899d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:48.463037 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cfd4fa45-c3f6-4755-b507-701501fe899d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:48.471041 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfd4fa45-c3f6-4755-b507-701501fe899d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:48.471668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfd4fa45-c3f6-4755-b507-701501fe899d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:48.472810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfd4fa45-c3f6-4755-b507-701501fe899d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:48.473493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfd4fa45-c3f6-4755-b507-701501fe899d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:48.542273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cfd4fa45-c3f6-4755-b507-701501fe899d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:48.551246 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cfd4fa45-c3f6-4755-b507-701501fe899d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092711 May 26 13:29:48.555021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 979/1984] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:48 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:49.568713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-75cd8d37-20e2-45e0-9404-59fd29429e5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:49.569254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-75cd8d37-20e2-45e0-9404-59fd29429e5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:49.575819 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75cd8d37-20e2-45e0-9404-59fd29429e5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:49.576276 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75cd8d37-20e2-45e0-9404-59fd29429e5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:49.577039 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75cd8d37-20e2-45e0-9404-59fd29429e5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:49.577905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75cd8d37-20e2-45e0-9404-59fd29429e5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:49.639637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-75cd8d37-20e2-45e0-9404-59fd29429e5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:49.647970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-75cd8d37-20e2-45e0-9404-59fd29429e5e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083134 May 26 13:29:49.648552 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1006/1985] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:49 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:50.665283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-689dc3e3-2117-4434-901e-b119b14e769e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:50.665948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-689dc3e3-2117-4434-901e-b119b14e769e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:50.673032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-689dc3e3-2117-4434-901e-b119b14e769e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:50.673479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-689dc3e3-2117-4434-901e-b119b14e769e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:50.674254 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-689dc3e3-2117-4434-901e-b119b14e769e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:50.674733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-689dc3e3-2117-4434-901e-b119b14e769e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:50.737346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-689dc3e3-2117-4434-901e-b119b14e769e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:50.745033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-689dc3e3-2117-4434-901e-b119b14e769e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083630 May 26 13:29:50.745622 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 980/1986] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:50 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:51.762847 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-25196dbd-06c3-451c-b1d0-a8c4899285fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:51.763524 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-25196dbd-06c3-451c-b1d0-a8c4899285fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:51.770779 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25196dbd-06c3-451c-b1d0-a8c4899285fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:51.771237 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25196dbd-06c3-451c-b1d0-a8c4899285fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:51.772009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25196dbd-06c3-451c-b1d0-a8c4899285fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:51.772443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25196dbd-06c3-451c-b1d0-a8c4899285fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:51.836699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-25196dbd-06c3-451c-b1d0-a8c4899285fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:51.844582 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-25196dbd-06c3-451c-b1d0-a8c4899285fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085606 May 26 13:29:51.845161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1007/1987] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:51 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:52.861735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f80153b2-691f-4aaa-951c-09501819f0bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:52.862356 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f80153b2-691f-4aaa-951c-09501819f0bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:52.868881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f80153b2-691f-4aaa-951c-09501819f0bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:52.869330 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f80153b2-691f-4aaa-951c-09501819f0bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:52.870120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f80153b2-691f-4aaa-951c-09501819f0bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:52.870579 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f80153b2-691f-4aaa-951c-09501819f0bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:52.937863 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f80153b2-691f-4aaa-951c-09501819f0bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:52.946557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f80153b2-691f-4aaa-951c-09501819f0bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089152 May 26 13:29:52.947194 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 981/1988] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:52 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:53.290002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:29:53.290175 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:29:53.963745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4bed5910-ca45-40a4-99a5-212980af0dfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:53.964389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4bed5910-ca45-40a4-99a5-212980af0dfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:53.970805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bed5910-ca45-40a4-99a5-212980af0dfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:53.977616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bed5910-ca45-40a4-99a5-212980af0dfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:53.977616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bed5910-ca45-40a4-99a5-212980af0dfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:53.977616 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bed5910-ca45-40a4-99a5-212980af0dfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:54.036306 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4bed5910-ca45-40a4-99a5-212980af0dfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:54.044100 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4bed5910-ca45-40a4-99a5-212980af0dfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084377 May 26 13:29:54.044675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1008/1989] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:53 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:55.061255 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba337549-6568-4874-a163-cb600db4f1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:55.063033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba337549-6568-4874-a163-cb600db4f1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:55.069665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba337549-6568-4874-a163-cb600db4f1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:55.070116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba337549-6568-4874-a163-cb600db4f1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:55.070910 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba337549-6568-4874-a163-cb600db4f1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:55.071368 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba337549-6568-4874-a163-cb600db4f1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:55.137230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba337549-6568-4874-a163-cb600db4f1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:55.145047 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba337549-6568-4874-a163-cb600db4f1dd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087726 May 26 13:29:55.145620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 982/1990] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:55 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:56.162135 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-abbbecb2-1e77-4233-9081-1a2669a94d83 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:56.162784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-abbbecb2-1e77-4233-9081-1a2669a94d83 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:56.169285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abbbecb2-1e77-4233-9081-1a2669a94d83 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:56.169737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abbbecb2-1e77-4233-9081-1a2669a94d83 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:56.170503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abbbecb2-1e77-4233-9081-1a2669a94d83 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:56.171164 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abbbecb2-1e77-4233-9081-1a2669a94d83 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:56.237327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-abbbecb2-1e77-4233-9081-1a2669a94d83 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:56.245766 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-abbbecb2-1e77-4233-9081-1a2669a94d83 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087454 May 26 13:29:56.246341 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1009/1991] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:56 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:57.263683 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05be9581-65a8-466e-a7c7-3bf8f908c390 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:57.264283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05be9581-65a8-466e-a7c7-3bf8f908c390 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:57.271339 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05be9581-65a8-466e-a7c7-3bf8f908c390 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:57.271787 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05be9581-65a8-466e-a7c7-3bf8f908c390 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:57.272550 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05be9581-65a8-466e-a7c7-3bf8f908c390 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:57.273018 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05be9581-65a8-466e-a7c7-3bf8f908c390 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:57.338574 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05be9581-65a8-466e-a7c7-3bf8f908c390 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:57.346868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05be9581-65a8-466e-a7c7-3bf8f908c390 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087168 May 26 13:29:57.347440 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 983/1992] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:57 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:58.364723 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aeb53e27-df9c-46d9-ae1b-a969e00928be tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:58.365348 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aeb53e27-df9c-46d9-ae1b-a969e00928be tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:58.372173 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aeb53e27-df9c-46d9-ae1b-a969e00928be tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:58.372630 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aeb53e27-df9c-46d9-ae1b-a969e00928be tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:58.373409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aeb53e27-df9c-46d9-ae1b-a969e00928be tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:58.373855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aeb53e27-df9c-46d9-ae1b-a969e00928be tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:58.441502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aeb53e27-df9c-46d9-ae1b-a969e00928be tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:58.449316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aeb53e27-df9c-46d9-ae1b-a969e00928be tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089270 May 26 13:29:58.449886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1010/1993] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:58 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:29:59.467610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f6b8701-9669-4838-b240-01a8848a57e6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:29:59.468229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f6b8701-9669-4838-b240-01a8848a57e6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:29:59.475176 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f6b8701-9669-4838-b240-01a8848a57e6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:59.475641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f6b8701-9669-4838-b240-01a8848a57e6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:59.476421 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f6b8701-9669-4838-b240-01a8848a57e6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:29:59.476865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f6b8701-9669-4838-b240-01a8848a57e6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:29:59.538649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2f6b8701-9669-4838-b240-01a8848a57e6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:29:59.546372 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f6b8701-9669-4838-b240-01a8848a57e6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083172 May 26 13:29:59.546960 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 984/1994] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:29:59 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:00.564158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7ac06064-0b49-4244-827e-51223846344f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:00.564735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7ac06064-0b49-4244-827e-51223846344f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:00.571991 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ac06064-0b49-4244-827e-51223846344f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:00.572442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ac06064-0b49-4244-827e-51223846344f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:00.573211 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ac06064-0b49-4244-827e-51223846344f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:00.573652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ac06064-0b49-4244-827e-51223846344f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:00.640341 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7ac06064-0b49-4244-827e-51223846344f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:00.648646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7ac06064-0b49-4244-827e-51223846344f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088487 May 26 13:30:00.649217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1011/1995] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:00 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:01.666112 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75dfd122-689d-4f38-8140-e5d0ca443dae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:01.666766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75dfd122-689d-4f38-8140-e5d0ca443dae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:01.673347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75dfd122-689d-4f38-8140-e5d0ca443dae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:01.673799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75dfd122-689d-4f38-8140-e5d0ca443dae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:01.674602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75dfd122-689d-4f38-8140-e5d0ca443dae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:01.675061 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75dfd122-689d-4f38-8140-e5d0ca443dae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:01.739794 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75dfd122-689d-4f38-8140-e5d0ca443dae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:01.747805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75dfd122-689d-4f38-8140-e5d0ca443dae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085588 May 26 13:30:01.748371 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 985/1996] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:01 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:02.767107 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0d3aeb80-f8e0-492d-87e1-0cd90f1008aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:02.767769 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0d3aeb80-f8e0-492d-87e1-0cd90f1008aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:02.776409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d3aeb80-f8e0-492d-87e1-0cd90f1008aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:02.776861 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d3aeb80-f8e0-492d-87e1-0cd90f1008aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:02.777637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d3aeb80-f8e0-492d-87e1-0cd90f1008aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:02.778079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d3aeb80-f8e0-492d-87e1-0cd90f1008aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:02.842629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0d3aeb80-f8e0-492d-87e1-0cd90f1008aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:02.854406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0d3aeb80-f8e0-492d-87e1-0cd90f1008aa tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.091070 May 26 13:30:02.855252 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1012/1997] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:02 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:30:03.871730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2cbb2728-593a-462d-8020-76d3c3757acc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:03.872359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2cbb2728-593a-462d-8020-76d3c3757acc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:03.879783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cbb2728-593a-462d-8020-76d3c3757acc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:03.880230 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cbb2728-593a-462d-8020-76d3c3757acc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:03.880997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cbb2728-593a-462d-8020-76d3c3757acc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:03.881480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cbb2728-593a-462d-8020-76d3c3757acc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:03.953679 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2cbb2728-593a-462d-8020-76d3c3757acc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:03.964209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2cbb2728-593a-462d-8020-76d3c3757acc tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.096009 May 26 13:30:03.964445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 986/1998] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:03 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:04.985221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9e49e2c-9070-42af-a5f8-1370cb488afd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:04.985830 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9e49e2c-9070-42af-a5f8-1370cb488afd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:04.988660 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:30:04.993352 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9e49e2c-9070-42af-a5f8-1370cb488afd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:04.993797 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9e49e2c-9070-42af-a5f8-1370cb488afd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:04.994570 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9e49e2c-9070-42af-a5f8-1370cb488afd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:04.995014 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9e49e2c-9070-42af-a5f8-1370cb488afd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:05.056857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9e49e2c-9070-42af-a5f8-1370cb488afd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:05.064590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9e49e2c-9070-42af-a5f8-1370cb488afd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083233 May 26 13:30:05.065166 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1013/1999] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:04 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:06.081768 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-08eb0b79-c1f3-4ac4-8324-d5f250e05936 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:06.082793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-08eb0b79-c1f3-4ac4-8324-d5f250e05936 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:06.085190 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:30:06.090247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08eb0b79-c1f3-4ac4-8324-d5f250e05936 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:06.090755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08eb0b79-c1f3-4ac4-8324-d5f250e05936 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:06.091538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08eb0b79-c1f3-4ac4-8324-d5f250e05936 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:06.091984 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08eb0b79-c1f3-4ac4-8324-d5f250e05936 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:06.155672 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08eb0b79-c1f3-4ac4-8324-d5f250e05936 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:06.163510 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-08eb0b79-c1f3-4ac4-8324-d5f250e05936 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086140 May 26 13:30:06.164080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 987/2000] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:06 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:07.180021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d40ad62-d172-4193-892a-5fefcb4e04c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:07.180636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6d40ad62-d172-4193-892a-5fefcb4e04c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:07.187690 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d40ad62-d172-4193-892a-5fefcb4e04c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:07.187995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d40ad62-d172-4193-892a-5fefcb4e04c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:07.188514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d40ad62-d172-4193-892a-5fefcb4e04c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:07.188948 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d40ad62-d172-4193-892a-5fefcb4e04c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:07.191880 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:30:07.253559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d40ad62-d172-4193-892a-5fefcb4e04c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:07.262719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6d40ad62-d172-4193-892a-5fefcb4e04c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086507 May 26 13:30:07.263315 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1014/2001] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:07 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:08.280216 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f379ffb4-fd51-40af-b994-e2b52618edf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:08.281277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f379ffb4-fd51-40af-b994-e2b52618edf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:08.288444 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f379ffb4-fd51-40af-b994-e2b52618edf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:08.288929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f379ffb4-fd51-40af-b994-e2b52618edf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:08.289696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f379ffb4-fd51-40af-b994-e2b52618edf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:08.290144 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f379ffb4-fd51-40af-b994-e2b52618edf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:08.292927 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:30:08.353020 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f379ffb4-fd51-40af-b994-e2b52618edf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:08.360707 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f379ffb4-fd51-40af-b994-e2b52618edf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084378 May 26 13:30:08.393278 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 988/2002] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:08 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:09.383649 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be576ec2-8f8f-40d5-b443-9b9a5b779cba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:09.384258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be576ec2-8f8f-40d5-b443-9b9a5b779cba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:09.390799 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be576ec2-8f8f-40d5-b443-9b9a5b779cba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:09.391257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be576ec2-8f8f-40d5-b443-9b9a5b779cba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:09.392019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be576ec2-8f8f-40d5-b443-9b9a5b779cba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:09.392442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be576ec2-8f8f-40d5-b443-9b9a5b779cba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:09.456500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be576ec2-8f8f-40d5-b443-9b9a5b779cba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:09.464157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be576ec2-8f8f-40d5-b443-9b9a5b779cba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084361 May 26 13:30:09.464806 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1015/2003] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:09 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:30:10.481872 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a2fdc1c7-be1a-4bcc-b9ef-4200563107a6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:10.482462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a2fdc1c7-be1a-4bcc-b9ef-4200563107a6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:10.489547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1c7-be1a-4bcc-b9ef-4200563107a6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:10.489993 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1c7-be1a-4bcc-b9ef-4200563107a6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:10.490810 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1c7-be1a-4bcc-b9ef-4200563107a6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:10.491252 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1c7-be1a-4bcc-b9ef-4200563107a6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:10.556046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a2fdc1c7-be1a-4bcc-b9ef-4200563107a6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:10.563578 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a2fdc1c7-be1a-4bcc-b9ef-4200563107a6 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086225 May 26 13:30:10.564143 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 989/2004] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:10 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:11.581262 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-da6ee30e-1de8-41bd-bc05-d557edb4fff8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:11.583093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-da6ee30e-1de8-41bd-bc05-d557edb4fff8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:11.589848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da6ee30e-1de8-41bd-bc05-d557edb4fff8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:11.590304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da6ee30e-1de8-41bd-bc05-d557edb4fff8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:11.591122 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da6ee30e-1de8-41bd-bc05-d557edb4fff8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:11.591564 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da6ee30e-1de8-41bd-bc05-d557edb4fff8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:11.654070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-da6ee30e-1de8-41bd-bc05-d557edb4fff8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:11.662878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-da6ee30e-1de8-41bd-bc05-d557edb4fff8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085497 May 26 13:30:11.663446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1016/2005] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:11 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:12.680283 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cec4023a-8589-4a84-aee9-c4790340f8ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:12.680926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cec4023a-8589-4a84-aee9-c4790340f8ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:12.687484 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cec4023a-8589-4a84-aee9-c4790340f8ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:12.687934 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cec4023a-8589-4a84-aee9-c4790340f8ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:12.688695 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cec4023a-8589-4a84-aee9-c4790340f8ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:12.689136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cec4023a-8589-4a84-aee9-c4790340f8ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:12.750961 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cec4023a-8589-4a84-aee9-c4790340f8ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:12.758609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cec4023a-8589-4a84-aee9-c4790340f8ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082880 May 26 13:30:12.759173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 990/2006] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:12 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:13.775499 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-24ebb3f5-c2fb-47fa-bfa0-ec5463525ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:13.776112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-24ebb3f5-c2fb-47fa-bfa0-ec5463525ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:13.782662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24ebb3f5-c2fb-47fa-bfa0-ec5463525ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:13.783119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24ebb3f5-c2fb-47fa-bfa0-ec5463525ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:13.783888 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24ebb3f5-c2fb-47fa-bfa0-ec5463525ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:13.784326 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24ebb3f5-c2fb-47fa-bfa0-ec5463525ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:13.849712 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24ebb3f5-c2fb-47fa-bfa0-ec5463525ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:13.857553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-24ebb3f5-c2fb-47fa-bfa0-ec5463525ab8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085942 May 26 13:30:13.858125 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1017/2007] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:13 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:14.875105 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d4add25d-60cd-49b5-8b39-1865d827d5eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:14.875711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d4add25d-60cd-49b5-8b39-1865d827d5eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:14.883090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4add25d-60cd-49b5-8b39-1865d827d5eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:14.883546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4add25d-60cd-49b5-8b39-1865d827d5eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:14.884315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4add25d-60cd-49b5-8b39-1865d827d5eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:14.884758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4add25d-60cd-49b5-8b39-1865d827d5eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:14.946453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d4add25d-60cd-49b5-8b39-1865d827d5eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:14.954028 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d4add25d-60cd-49b5-8b39-1865d827d5eb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082856 May 26 13:30:14.954619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 991/2008] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:14 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:15.971433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a07ede7e-4fe2-48a1-9b49-8dbdc9801f4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:15.972049 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a07ede7e-4fe2-48a1-9b49-8dbdc9801f4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:15.979440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a07ede7e-4fe2-48a1-9b49-8dbdc9801f4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:15.979900 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a07ede7e-4fe2-48a1-9b49-8dbdc9801f4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:15.980666 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a07ede7e-4fe2-48a1-9b49-8dbdc9801f4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:15.981111 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a07ede7e-4fe2-48a1-9b49-8dbdc9801f4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:16.041266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a07ede7e-4fe2-48a1-9b49-8dbdc9801f4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:16.049367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a07ede7e-4fe2-48a1-9b49-8dbdc9801f4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081798 May 26 13:30:16.049938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1018/2009] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:15 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:17.065233 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75b26118-099c-4483-a5d8-242b2db3ead8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:17.065843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75b26118-099c-4483-a5d8-242b2db3ead8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:17.074803 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75b26118-099c-4483-a5d8-242b2db3ead8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:17.075514 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75b26118-099c-4483-a5d8-242b2db3ead8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:17.076817 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75b26118-099c-4483-a5d8-242b2db3ead8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:17.077517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75b26118-099c-4483-a5d8-242b2db3ead8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:17.140025 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75b26118-099c-4483-a5d8-242b2db3ead8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:17.147854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75b26118-099c-4483-a5d8-242b2db3ead8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086465 May 26 13:30:17.148441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 992/2010] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:17 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:18.164730 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9dcebd23-fa0c-4a87-8c85-26ec0d97bb10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:18.165342 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9dcebd23-fa0c-4a87-8c85-26ec0d97bb10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:18.171877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9dcebd23-fa0c-4a87-8c85-26ec0d97bb10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:18.172325 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9dcebd23-fa0c-4a87-8c85-26ec0d97bb10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:18.173091 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9dcebd23-fa0c-4a87-8c85-26ec0d97bb10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:18.173532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9dcebd23-fa0c-4a87-8c85-26ec0d97bb10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:18.240005 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9dcebd23-fa0c-4a87-8c85-26ec0d97bb10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:18.248066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9dcebd23-fa0c-4a87-8c85-26ec0d97bb10 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087142 May 26 13:30:18.248744 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1019/2011] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:18 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:19.265573 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c12e20c2-831f-4f9b-b8be-a6189d70fe85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:19.266231 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c12e20c2-831f-4f9b-b8be-a6189d70fe85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:19.273963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c12e20c2-831f-4f9b-b8be-a6189d70fe85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:19.274413 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c12e20c2-831f-4f9b-b8be-a6189d70fe85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:19.275214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c12e20c2-831f-4f9b-b8be-a6189d70fe85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:19.275658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c12e20c2-831f-4f9b-b8be-a6189d70fe85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:19.341234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c12e20c2-831f-4f9b-b8be-a6189d70fe85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:19.349757 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c12e20c2-831f-4f9b-b8be-a6189d70fe85 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087326 May 26 13:30:19.350399 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 993/2012] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:19 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:20.367905 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f0d1b14-4586-4797-9b56-f3651463761f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:20.368448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f0d1b14-4586-4797-9b56-f3651463761f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:20.374962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f0d1b14-4586-4797-9b56-f3651463761f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:20.375461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f0d1b14-4586-4797-9b56-f3651463761f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:20.376184 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f0d1b14-4586-4797-9b56-f3651463761f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:20.376624 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f0d1b14-4586-4797-9b56-f3651463761f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:20.436902 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f0d1b14-4586-4797-9b56-f3651463761f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:20.445120 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f0d1b14-4586-4797-9b56-f3651463761f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082074 May 26 13:30:20.445698 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1020/2013] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:20 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:30:21.464008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e7afc19-1274-42af-93dd-edb39f72fc63 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:21.464609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e7afc19-1274-42af-93dd-edb39f72fc63 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:21.470977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e7afc19-1274-42af-93dd-edb39f72fc63 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:21.471431 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e7afc19-1274-42af-93dd-edb39f72fc63 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:21.472221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e7afc19-1274-42af-93dd-edb39f72fc63 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:21.472662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e7afc19-1274-42af-93dd-edb39f72fc63 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:21.533747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e7afc19-1274-42af-93dd-edb39f72fc63 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:21.542151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e7afc19-1274-42af-93dd-edb39f72fc63 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083415 May 26 13:30:21.542763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 994/2014] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:21 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:22.559780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-946ffc33-1ab4-4adc-9a75-29dceedeed1c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:22.560406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-946ffc33-1ab4-4adc-9a75-29dceedeed1c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:22.566683 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-946ffc33-1ab4-4adc-9a75-29dceedeed1c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:22.567136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-946ffc33-1ab4-4adc-9a75-29dceedeed1c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:22.567896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-946ffc33-1ab4-4adc-9a75-29dceedeed1c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:22.568330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-946ffc33-1ab4-4adc-9a75-29dceedeed1c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:22.635295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-946ffc33-1ab4-4adc-9a75-29dceedeed1c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:22.643998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-946ffc33-1ab4-4adc-9a75-29dceedeed1c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087859 May 26 13:30:22.644777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1021/2015] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:22 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:23.662871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e35a7be2-9f3f-405f-bd6b-dd9eeef53bdb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:23.663498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e35a7be2-9f3f-405f-bd6b-dd9eeef53bdb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:23.670058 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e35a7be2-9f3f-405f-bd6b-dd9eeef53bdb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:23.670507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e35a7be2-9f3f-405f-bd6b-dd9eeef53bdb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:23.671306 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e35a7be2-9f3f-405f-bd6b-dd9eeef53bdb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:23.671746 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e35a7be2-9f3f-405f-bd6b-dd9eeef53bdb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:23.732585 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e35a7be2-9f3f-405f-bd6b-dd9eeef53bdb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:23.740066 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e35a7be2-9f3f-405f-bd6b-dd9eeef53bdb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081343 May 26 13:30:23.741201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 995/2016] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:23 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:24.758335 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec9952af-b4e2-4220-ad6e-cf17e38799c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:24.759193 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec9952af-b4e2-4220-ad6e-cf17e38799c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:24.765596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec9952af-b4e2-4220-ad6e-cf17e38799c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:24.766045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec9952af-b4e2-4220-ad6e-cf17e38799c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:24.766859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec9952af-b4e2-4220-ad6e-cf17e38799c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:24.767295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec9952af-b4e2-4220-ad6e-cf17e38799c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:24.832527 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec9952af-b4e2-4220-ad6e-cf17e38799c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:24.840321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec9952af-b4e2-4220-ad6e-cf17e38799c2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086343 May 26 13:30:24.840935 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1022/2017] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:24 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:25.858174 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4342fb71-6d1e-4b31-9ae0-1927c6886a9d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:25.858900 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4342fb71-6d1e-4b31-9ae0-1927c6886a9d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:25.865255 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4342fb71-6d1e-4b31-9ae0-1927c6886a9d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:25.865706 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4342fb71-6d1e-4b31-9ae0-1927c6886a9d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:25.866461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4342fb71-6d1e-4b31-9ae0-1927c6886a9d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:25.867232 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4342fb71-6d1e-4b31-9ae0-1927c6886a9d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:25.928033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4342fb71-6d1e-4b31-9ae0-1927c6886a9d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:25.936581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4342fb71-6d1e-4b31-9ae0-1927c6886a9d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082145 May 26 13:30:25.937178 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 996/2018] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:25 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:26.954366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-931c7e47-73bf-478e-93be-28ce4272350c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:26.954998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-931c7e47-73bf-478e-93be-28ce4272350c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:26.961833 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-931c7e47-73bf-478e-93be-28ce4272350c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:26.968333 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-931c7e47-73bf-478e-93be-28ce4272350c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:26.968333 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-931c7e47-73bf-478e-93be-28ce4272350c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:26.968333 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-931c7e47-73bf-478e-93be-28ce4272350c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:27.029586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-931c7e47-73bf-478e-93be-28ce4272350c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:27.037172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-931c7e47-73bf-478e-93be-28ce4272350c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086657 May 26 13:30:27.037735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1023/2019] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:26 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:28.055140 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb28943e-176b-450d-8e1e-044d2128601d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:28.055748 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb28943e-176b-450d-8e1e-044d2128601d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:28.062191 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb28943e-176b-450d-8e1e-044d2128601d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:28.062675 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb28943e-176b-450d-8e1e-044d2128601d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:28.063438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb28943e-176b-450d-8e1e-044d2128601d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:28.063875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb28943e-176b-450d-8e1e-044d2128601d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:28.129267 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb28943e-176b-450d-8e1e-044d2128601d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:28.137009 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb28943e-176b-450d-8e1e-044d2128601d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085839 May 26 13:30:28.137568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 997/2020] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:28 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:29.154225 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-910e952b-e33b-4d96-a6c5-ccf3a5897bf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:29.154863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-910e952b-e33b-4d96-a6c5-ccf3a5897bf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:29.161414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-910e952b-e33b-4d96-a6c5-ccf3a5897bf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:29.161871 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-910e952b-e33b-4d96-a6c5-ccf3a5897bf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:29.162756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-910e952b-e33b-4d96-a6c5-ccf3a5897bf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:29.163192 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-910e952b-e33b-4d96-a6c5-ccf3a5897bf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:29.229259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-910e952b-e33b-4d96-a6c5-ccf3a5897bf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:29.236973 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-910e952b-e33b-4d96-a6c5-ccf3a5897bf3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086694 May 26 13:30:29.237542 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1024/2021] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:29 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:30.254556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-58cef6d2-7491-4e0d-80e4-4f193a291322 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:30.255175 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-58cef6d2-7491-4e0d-80e4-4f193a291322 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:30.262831 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58cef6d2-7491-4e0d-80e4-4f193a291322 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:30.263306 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58cef6d2-7491-4e0d-80e4-4f193a291322 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:30.264078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58cef6d2-7491-4e0d-80e4-4f193a291322 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:30.264514 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58cef6d2-7491-4e0d-80e4-4f193a291322 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:30.327099 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-58cef6d2-7491-4e0d-80e4-4f193a291322 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:30.334653 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-58cef6d2-7491-4e0d-80e4-4f193a291322 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084076 May 26 13:30:30.335432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 998/2022] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:30 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:31.351398 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-804cc900-7558-404b-a787-ccb16729ee7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:31.352051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-804cc900-7558-404b-a787-ccb16729ee7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:31.358791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-804cc900-7558-404b-a787-ccb16729ee7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:31.359243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-804cc900-7558-404b-a787-ccb16729ee7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:31.360008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-804cc900-7558-404b-a787-ccb16729ee7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:31.360444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-804cc900-7558-404b-a787-ccb16729ee7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:31.420380 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-804cc900-7558-404b-a787-ccb16729ee7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:31.427957 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-804cc900-7558-404b-a787-ccb16729ee7d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080456 May 26 13:30:31.428525 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1025/2023] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:31 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:32.445057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-44a348b1-564b-41c0-8c39-8198accd0759 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:32.445681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-44a348b1-564b-41c0-8c39-8198accd0759 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:32.452348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44a348b1-564b-41c0-8c39-8198accd0759 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:32.452809 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44a348b1-564b-41c0-8c39-8198accd0759 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:32.453580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44a348b1-564b-41c0-8c39-8198accd0759 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:32.454026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44a348b1-564b-41c0-8c39-8198accd0759 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:32.515534 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-44a348b1-564b-41c0-8c39-8198accd0759 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:32.523714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-44a348b1-564b-41c0-8c39-8198accd0759 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082719 May 26 13:30:32.524472 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 999/2024] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:32 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:33.541865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a8d86af-6920-4165-9c72-4c338f7d5b54 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:33.542409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a8d86af-6920-4165-9c72-4c338f7d5b54 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:33.548320 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a8d86af-6920-4165-9c72-4c338f7d5b54 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:33.548764 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a8d86af-6920-4165-9c72-4c338f7d5b54 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:33.549558 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a8d86af-6920-4165-9c72-4c338f7d5b54 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:33.549995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a8d86af-6920-4165-9c72-4c338f7d5b54 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:33.611590 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a8d86af-6920-4165-9c72-4c338f7d5b54 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:33.620105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a8d86af-6920-4165-9c72-4c338f7d5b54 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083230 May 26 13:30:33.620674 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1026/2025] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:33 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:34.638168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ae10fe7-b12c-436f-9314-4dab88c0898c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:34.638802 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ae10fe7-b12c-436f-9314-4dab88c0898c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:34.645280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ae10fe7-b12c-436f-9314-4dab88c0898c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:34.645731 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ae10fe7-b12c-436f-9314-4dab88c0898c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:34.646486 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ae10fe7-b12c-436f-9314-4dab88c0898c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:34.646944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ae10fe7-b12c-436f-9314-4dab88c0898c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:34.707807 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ae10fe7-b12c-436f-9314-4dab88c0898c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:34.715445 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ae10fe7-b12c-436f-9314-4dab88c0898c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081438 May 26 13:30:34.716256 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1000/2026] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:34 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:35.732675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca6475ce-e18c-42a7-8530-23dc1e4c5be0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:35.733323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca6475ce-e18c-42a7-8530-23dc1e4c5be0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:35.735678 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:30:35.740427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6475ce-e18c-42a7-8530-23dc1e4c5be0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:35.740877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6475ce-e18c-42a7-8530-23dc1e4c5be0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:35.741645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6475ce-e18c-42a7-8530-23dc1e4c5be0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:35.742309 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6475ce-e18c-42a7-8530-23dc1e4c5be0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:35.807324 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ca6475ce-e18c-42a7-8530-23dc1e4c5be0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:35.814798 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca6475ce-e18c-42a7-8530-23dc1e4c5be0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085904 May 26 13:30:35.815367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1027/2027] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:35 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:36.832563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0647bd83-9a62-497d-8e5d-4445e36f3614 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:36.833182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0647bd83-9a62-497d-8e5d-4445e36f3614 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:36.836408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:30:36.841206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0647bd83-9a62-497d-8e5d-4445e36f3614 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:36.841660 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0647bd83-9a62-497d-8e5d-4445e36f3614 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:36.842436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0647bd83-9a62-497d-8e5d-4445e36f3614 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:36.842899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0647bd83-9a62-497d-8e5d-4445e36f3614 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:36.909481 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0647bd83-9a62-497d-8e5d-4445e36f3614 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:36.919753 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0647bd83-9a62-497d-8e5d-4445e36f3614 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.091022 May 26 13:30:36.920586 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1001/2028] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:36 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:37.936735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-73030c95-45a0-4192-b2d1-55ed8725a413 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:37.937353 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-73030c95-45a0-4192-b2d1-55ed8725a413 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:37.943952 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73030c95-45a0-4192-b2d1-55ed8725a413 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:37.944409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73030c95-45a0-4192-b2d1-55ed8725a413 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:37.945244 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73030c95-45a0-4192-b2d1-55ed8725a413 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:37.945689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73030c95-45a0-4192-b2d1-55ed8725a413 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:37.948331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:30:38.009114 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-73030c95-45a0-4192-b2d1-55ed8725a413 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:38.016674 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-73030c95-45a0-4192-b2d1-55ed8725a413 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083806 May 26 13:30:38.017230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1028/2029] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:37 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:39.033215 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06fef557-597d-4871-a2b7-0f57eefc74a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:39.033820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06fef557-597d-4871-a2b7-0f57eefc74a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:39.040688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06fef557-597d-4871-a2b7-0f57eefc74a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:39.041150 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06fef557-597d-4871-a2b7-0f57eefc74a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:39.042056 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06fef557-597d-4871-a2b7-0f57eefc74a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:39.042500 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06fef557-597d-4871-a2b7-0f57eefc74a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:39.102568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06fef557-597d-4871-a2b7-0f57eefc74a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:39.110288 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06fef557-597d-4871-a2b7-0f57eefc74a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080967 May 26 13:30:39.110886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1002/2030] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:39 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:40.128973 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a7eae724-fe1e-4488-8046-c3611d13b87e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:40.129595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a7eae724-fe1e-4488-8046-c3611d13b87e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:40.136330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7eae724-fe1e-4488-8046-c3611d13b87e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:40.136792 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7eae724-fe1e-4488-8046-c3611d13b87e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:40.137578 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7eae724-fe1e-4488-8046-c3611d13b87e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:40.138022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7eae724-fe1e-4488-8046-c3611d13b87e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:40.200181 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7eae724-fe1e-4488-8046-c3611d13b87e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:40.207821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a7eae724-fe1e-4488-8046-c3611d13b87e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083266 May 26 13:30:40.208399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1029/2031] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:40 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:41.225771 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-37277bed-e8b9-4910-b686-f0ae39fe6886 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:41.227076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-37277bed-e8b9-4910-b686-f0ae39fe6886 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:41.233861 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37277bed-e8b9-4910-b686-f0ae39fe6886 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:41.234317 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37277bed-e8b9-4910-b686-f0ae39fe6886 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:41.235136 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37277bed-e8b9-4910-b686-f0ae39fe6886 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:41.235766 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37277bed-e8b9-4910-b686-f0ae39fe6886 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:41.238183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=90 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:30:41.303511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-37277bed-e8b9-4910-b686-f0ae39fe6886 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:41.312580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-37277bed-e8b9-4910-b686-f0ae39fe6886 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089528 May 26 13:30:41.312580 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1003/2032] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:41 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:42.328197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-26935e8e-4549-422b-aa43-5e8a56fc86e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:42.328756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-26935e8e-4549-422b-aa43-5e8a56fc86e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:42.335608 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26935e8e-4549-422b-aa43-5e8a56fc86e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:42.336194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26935e8e-4549-422b-aa43-5e8a56fc86e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:42.336907 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26935e8e-4549-422b-aa43-5e8a56fc86e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:42.337366 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26935e8e-4549-422b-aa43-5e8a56fc86e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:42.399791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-26935e8e-4549-422b-aa43-5e8a56fc86e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:42.407327 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-26935e8e-4549-422b-aa43-5e8a56fc86e3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083190 May 26 13:30:42.407904 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1030/2033] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:42 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:43.425193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-54cac3fe-7e9e-4784-b664-d3c542d4fd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:43.425800 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-54cac3fe-7e9e-4784-b664-d3c542d4fd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:43.432975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54cac3fe-7e9e-4784-b664-d3c542d4fd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:43.433433 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54cac3fe-7e9e-4784-b664-d3c542d4fd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:43.434206 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54cac3fe-7e9e-4784-b664-d3c542d4fd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:43.434679 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54cac3fe-7e9e-4784-b664-d3c542d4fd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:43.496938 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-54cac3fe-7e9e-4784-b664-d3c542d4fd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:43.504783 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-54cac3fe-7e9e-4784-b664-d3c542d4fd92 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083474 May 26 13:30:43.505353 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1004/2034] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:43 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:44.522167 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f50c97b6-3905-4b5b-898e-c32a03e52028 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:44.523357 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f50c97b6-3905-4b5b-898e-c32a03e52028 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:44.530265 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50c97b6-3905-4b5b-898e-c32a03e52028 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:44.530821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50c97b6-3905-4b5b-898e-c32a03e52028 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:44.531533 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50c97b6-3905-4b5b-898e-c32a03e52028 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:44.531970 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50c97b6-3905-4b5b-898e-c32a03e52028 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:44.600043 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f50c97b6-3905-4b5b-898e-c32a03e52028 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:44.608596 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f50c97b6-3905-4b5b-898e-c32a03e52028 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090246 May 26 13:30:44.609172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1031/2035] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:44 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:45.624911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c96f918c-03b6-436f-9349-e6676a6c1326 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:45.625610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c96f918c-03b6-436f-9349-e6676a6c1326 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:45.632493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c96f918c-03b6-436f-9349-e6676a6c1326 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:45.632959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c96f918c-03b6-436f-9349-e6676a6c1326 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:45.634245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c96f918c-03b6-436f-9349-e6676a6c1326 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:45.634811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c96f918c-03b6-436f-9349-e6676a6c1326 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:45.703148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c96f918c-03b6-436f-9349-e6676a6c1326 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:45.710968 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c96f918c-03b6-436f-9349-e6676a6c1326 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089929 May 26 13:30:45.711843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1005/2036] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:45 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:46.730141 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f0206d4d-dd0e-4492-81e7-ffbbca0c28e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:46.730775 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f0206d4d-dd0e-4492-81e7-ffbbca0c28e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:46.737580 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0206d4d-dd0e-4492-81e7-ffbbca0c28e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:46.739457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0206d4d-dd0e-4492-81e7-ffbbca0c28e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:46.739457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0206d4d-dd0e-4492-81e7-ffbbca0c28e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:46.739457 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0206d4d-dd0e-4492-81e7-ffbbca0c28e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:46.803183 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f0206d4d-dd0e-4492-81e7-ffbbca0c28e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:46.811145 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f0206d4d-dd0e-4492-81e7-ffbbca0c28e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086269 May 26 13:30:46.811724 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1032/2037] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:46 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:47.829021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06dd2e29-5425-4763-9c5f-99c142f3d8a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:47.829634 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06dd2e29-5425-4763-9c5f-99c142f3d8a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:47.836228 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06dd2e29-5425-4763-9c5f-99c142f3d8a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:47.836682 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06dd2e29-5425-4763-9c5f-99c142f3d8a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:47.837452 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06dd2e29-5425-4763-9c5f-99c142f3d8a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:47.837889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06dd2e29-5425-4763-9c5f-99c142f3d8a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:47.900647 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06dd2e29-5425-4763-9c5f-99c142f3d8a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:47.911100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06dd2e29-5425-4763-9c5f-99c142f3d8a9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084634 May 26 13:30:47.911100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1006/2038] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:47 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:48.927356 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ac08cc4d-029b-4c2b-9a2e-a1cd3c585838 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:48.927955 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ac08cc4d-029b-4c2b-9a2e-a1cd3c585838 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:48.934702 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac08cc4d-029b-4c2b-9a2e-a1cd3c585838 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:48.939464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac08cc4d-029b-4c2b-9a2e-a1cd3c585838 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:48.939464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac08cc4d-029b-4c2b-9a2e-a1cd3c585838 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:48.939464 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac08cc4d-029b-4c2b-9a2e-a1cd3c585838 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:48.999663 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ac08cc4d-029b-4c2b-9a2e-a1cd3c585838 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:49.007357 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ac08cc4d-029b-4c2b-9a2e-a1cd3c585838 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084054 May 26 13:30:49.007933 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1033/2039] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:48 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:50.024499 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a820d8f4-6f4d-4d42-8787-e8c50683efe3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:50.025234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a820d8f4-6f4d-4d42-8787-e8c50683efe3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:50.031713 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a820d8f4-6f4d-4d42-8787-e8c50683efe3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:50.032173 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a820d8f4-6f4d-4d42-8787-e8c50683efe3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:50.032976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a820d8f4-6f4d-4d42-8787-e8c50683efe3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:50.033418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a820d8f4-6f4d-4d42-8787-e8c50683efe3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:50.102557 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a820d8f4-6f4d-4d42-8787-e8c50683efe3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:50.116722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a820d8f4-6f4d-4d42-8787-e8c50683efe3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.096233 May 26 13:30:50.117829 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1007/2040] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:50 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:51.135648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2210048-24b9-4505-bd88-66aa70c927bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:51.136264 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2210048-24b9-4505-bd88-66aa70c927bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:51.143449 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2210048-24b9-4505-bd88-66aa70c927bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:51.143893 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2210048-24b9-4505-bd88-66aa70c927bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:51.144652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2210048-24b9-4505-bd88-66aa70c927bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:51.145085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2210048-24b9-4505-bd88-66aa70c927bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:51.206939 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2210048-24b9-4505-bd88-66aa70c927bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:51.214468 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2210048-24b9-4505-bd88-66aa70c927bb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082753 May 26 13:30:51.215520 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1034/2041] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:51 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:30:52.232912 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5e67f23-bd27-48b4-9ee6-b60bf08b441a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:52.233654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d5e67f23-bd27-48b4-9ee6-b60bf08b441a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:52.240749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5e67f23-bd27-48b4-9ee6-b60bf08b441a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:52.242235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5e67f23-bd27-48b4-9ee6-b60bf08b441a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:52.242235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5e67f23-bd27-48b4-9ee6-b60bf08b441a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:52.242799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5e67f23-bd27-48b4-9ee6-b60bf08b441a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:52.306687 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d5e67f23-bd27-48b4-9ee6-b60bf08b441a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:52.315105 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d5e67f23-bd27-48b4-9ee6-b60bf08b441a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087147 May 26 13:30:52.315691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1008/2042] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:52 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:53.332215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5562df64-618d-4ca1-adec-0037b4a81cd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:53.332829 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5562df64-618d-4ca1-adec-0037b4a81cd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:53.339131 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5562df64-618d-4ca1-adec-0037b4a81cd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:53.339593 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5562df64-618d-4ca1-adec-0037b4a81cd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:53.340571 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5562df64-618d-4ca1-adec-0037b4a81cd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:53.341224 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5562df64-618d-4ca1-adec-0037b4a81cd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:53.407646 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5562df64-618d-4ca1-adec-0037b4a81cd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:53.415229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5562df64-618d-4ca1-adec-0037b4a81cd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086878 May 26 13:30:53.415790 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1035/2043] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:53 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:54.432344 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4cd4cfcd-4474-47bb-af0b-0edab1216cf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:54.432965 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4cd4cfcd-4474-47bb-af0b-0edab1216cf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:54.440240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cd4cfcd-4474-47bb-af0b-0edab1216cf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:54.440697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cd4cfcd-4474-47bb-af0b-0edab1216cf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:54.441465 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cd4cfcd-4474-47bb-af0b-0edab1216cf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:54.441903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cd4cfcd-4474-47bb-af0b-0edab1216cf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:54.507559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4cd4cfcd-4474-47bb-af0b-0edab1216cf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:54.516200 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4cd4cfcd-4474-47bb-af0b-0edab1216cf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087616 May 26 13:30:54.516790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1009/2044] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:54 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:55.534247 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42b623ba-732b-4d79-bdf3-73c997885991 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:55.534848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42b623ba-732b-4d79-bdf3-73c997885991 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:55.541597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42b623ba-732b-4d79-bdf3-73c997885991 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:55.542042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42b623ba-732b-4d79-bdf3-73c997885991 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:55.542844 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42b623ba-732b-4d79-bdf3-73c997885991 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:55.544594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42b623ba-732b-4d79-bdf3-73c997885991 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:55.610331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42b623ba-732b-4d79-bdf3-73c997885991 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:55.618207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42b623ba-732b-4d79-bdf3-73c997885991 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087925 May 26 13:30:55.618823 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1036/2045] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:55 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:56.635351 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-17d1429e-9ebb-4af9-9a7b-8c9035898fee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:56.636010 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-17d1429e-9ebb-4af9-9a7b-8c9035898fee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:56.642564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17d1429e-9ebb-4af9-9a7b-8c9035898fee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:56.643013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17d1429e-9ebb-4af9-9a7b-8c9035898fee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:56.643775 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17d1429e-9ebb-4af9-9a7b-8c9035898fee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:56.644210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17d1429e-9ebb-4af9-9a7b-8c9035898fee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:56.705261 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-17d1429e-9ebb-4af9-9a7b-8c9035898fee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:56.712714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-17d1429e-9ebb-4af9-9a7b-8c9035898fee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081217 May 26 13:30:56.713273 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1010/2046] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:56 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:57.729607 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a3e4495-f671-4e0c-82ae-3de7242bc0ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:57.730214 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a3e4495-f671-4e0c-82ae-3de7242bc0ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:57.737161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3e4495-f671-4e0c-82ae-3de7242bc0ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:57.737697 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3e4495-f671-4e0c-82ae-3de7242bc0ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:57.738513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3e4495-f671-4e0c-82ae-3de7242bc0ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:57.738976 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3e4495-f671-4e0c-82ae-3de7242bc0ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:57.804050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a3e4495-f671-4e0c-82ae-3de7242bc0ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:57.812157 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a3e4495-f671-4e0c-82ae-3de7242bc0ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086657 May 26 13:30:57.812878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1037/2047] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:57 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:58.830415 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbcfff56-0353-4377-850f-287441624e18 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:58.831052 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbcfff56-0353-4377-850f-287441624e18 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:58.837814 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbcfff56-0353-4377-850f-287441624e18 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:58.838258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbcfff56-0353-4377-850f-287441624e18 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:58.839062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbcfff56-0353-4377-850f-287441624e18 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:58.839507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbcfff56-0353-4377-850f-287441624e18 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:58.902190 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbcfff56-0353-4377-850f-287441624e18 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:30:58.910469 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbcfff56-0353-4377-850f-287441624e18 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084848 May 26 13:30:58.911054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1011/2048] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:58 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:30:59.928017 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d094128-de3f-4ed0-897e-c8f7cdfdce64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:30:59.928638 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d094128-de3f-4ed0-897e-c8f7cdfdce64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:30:59.935499 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d094128-de3f-4ed0-897e-c8f7cdfdce64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:59.935974 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d094128-de3f-4ed0-897e-c8f7cdfdce64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:30:59.936826 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d094128-de3f-4ed0-897e-c8f7cdfdce64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:30:59.937274 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d094128-de3f-4ed0-897e-c8f7cdfdce64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:00.004545 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d094128-de3f-4ed0-897e-c8f7cdfdce64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:00.012791 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d094128-de3f-4ed0-897e-c8f7cdfdce64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088766 May 26 13:31:00.013384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1038/2049] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:30:59 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:01.029238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-be3f17fe-20bf-4d61-92ea-b0b669671603 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:01.030454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-be3f17fe-20bf-4d61-92ea-b0b669671603 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:01.036997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be3f17fe-20bf-4d61-92ea-b0b669671603 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:01.037480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be3f17fe-20bf-4d61-92ea-b0b669671603 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:01.038266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be3f17fe-20bf-4d61-92ea-b0b669671603 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:01.038762 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be3f17fe-20bf-4d61-92ea-b0b669671603 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:01.104850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-be3f17fe-20bf-4d61-92ea-b0b669671603 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:01.112749 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-be3f17fe-20bf-4d61-92ea-b0b669671603 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087369 May 26 13:31:01.113357 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1012/2050] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:01 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:02.129709 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6a82e67-b89f-4558-9996-89e5b1ea68fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:02.130310 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6a82e67-b89f-4558-9996-89e5b1ea68fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:02.136911 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6a82e67-b89f-4558-9996-89e5b1ea68fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:02.137367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6a82e67-b89f-4558-9996-89e5b1ea68fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:02.138133 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6a82e67-b89f-4558-9996-89e5b1ea68fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:02.138604 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6a82e67-b89f-4558-9996-89e5b1ea68fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:02.205258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6a82e67-b89f-4558-9996-89e5b1ea68fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:02.214406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6a82e67-b89f-4558-9996-89e5b1ea68fe tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087831 May 26 13:31:02.219425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1039/2051] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:02 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:03.240830 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-40baeabb-5014-40e9-9696-2336b3a7edf2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:03.241441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-40baeabb-5014-40e9-9696-2336b3a7edf2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:03.248151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40baeabb-5014-40e9-9696-2336b3a7edf2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:03.248788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40baeabb-5014-40e9-9696-2336b3a7edf2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:03.250075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40baeabb-5014-40e9-9696-2336b3a7edf2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:03.250668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40baeabb-5014-40e9-9696-2336b3a7edf2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:03.319326 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40baeabb-5014-40e9-9696-2336b3a7edf2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:03.327156 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-40baeabb-5014-40e9-9696-2336b3a7edf2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090053 May 26 13:31:03.327539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1013/2052] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:03 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:04.345605 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-46ad92eb-ba1d-4bf1-9768-210f37e3aa3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:04.346261 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-46ad92eb-ba1d-4bf1-9768-210f37e3aa3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:04.353568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46ad92eb-ba1d-4bf1-9768-210f37e3aa3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:04.354020 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46ad92eb-ba1d-4bf1-9768-210f37e3aa3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:04.354865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46ad92eb-ba1d-4bf1-9768-210f37e3aa3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:04.355307 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46ad92eb-ba1d-4bf1-9768-210f37e3aa3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:04.424182 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-46ad92eb-ba1d-4bf1-9768-210f37e3aa3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:04.432288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-46ad92eb-ba1d-4bf1-9768-210f37e3aa3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092122 May 26 13:31:04.432865 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1040/2053] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:04 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:05.449641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-67c5e61e-dde2-4d65-9c1c-e184e85b48ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:05.450408 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-67c5e61e-dde2-4d65-9c1c-e184e85b48ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:05.457023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67c5e61e-dde2-4d65-9c1c-e184e85b48ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:05.457471 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67c5e61e-dde2-4d65-9c1c-e184e85b48ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:05.458239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67c5e61e-dde2-4d65-9c1c-e184e85b48ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:05.458709 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67c5e61e-dde2-4d65-9c1c-e184e85b48ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:05.520593 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-67c5e61e-dde2-4d65-9c1c-e184e85b48ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:05.527951 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-67c5e61e-dde2-4d65-9c1c-e184e85b48ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082206 May 26 13:31:05.528571 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1014/2054] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:05 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:05.836973 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:31:05.837572 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:31:06.547095 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8595ca5f-81ba-4df6-85f9-0b187cb4b91c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:06.548036 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8595ca5f-81ba-4df6-85f9-0b187cb4b91c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:06.551694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:06.559085 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8595ca5f-81ba-4df6-85f9-0b187cb4b91c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:06.559845 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8595ca5f-81ba-4df6-85f9-0b187cb4b91c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:06.560961 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8595ca5f-81ba-4df6-85f9-0b187cb4b91c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:06.561752 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8595ca5f-81ba-4df6-85f9-0b187cb4b91c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:06.628331 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8595ca5f-81ba-4df6-85f9-0b187cb4b91c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:06.635887 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8595ca5f-81ba-4df6-85f9-0b187cb4b91c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.094752 May 26 13:31:06.636450 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1041/2055] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:06 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:07.653358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd4dd3db-22b7-4a2c-add4-68ab7db8b6ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:07.653973 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd4dd3db-22b7-4a2c-add4-68ab7db8b6ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:07.657414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:07.662182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd4dd3db-22b7-4a2c-add4-68ab7db8b6ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:07.662730 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd4dd3db-22b7-4a2c-add4-68ab7db8b6ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:07.663500 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd4dd3db-22b7-4a2c-add4-68ab7db8b6ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:07.663941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd4dd3db-22b7-4a2c-add4-68ab7db8b6ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:07.726275 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bd4dd3db-22b7-4a2c-add4-68ab7db8b6ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:07.733955 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd4dd3db-22b7-4a2c-add4-68ab7db8b6ae tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084525 May 26 13:31:07.734568 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1015/2056] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:07 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:08.751701 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-26a64ca0-1d35-4b7d-8d66-ba0b0009a53c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:08.752326 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-26a64ca0-1d35-4b7d-8d66-ba0b0009a53c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:08.758982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26a64ca0-1d35-4b7d-8d66-ba0b0009a53c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:08.759442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26a64ca0-1d35-4b7d-8d66-ba0b0009a53c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:08.760216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26a64ca0-1d35-4b7d-8d66-ba0b0009a53c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:08.760659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26a64ca0-1d35-4b7d-8d66-ba0b0009a53c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:08.763289 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:08.822998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-26a64ca0-1d35-4b7d-8d66-ba0b0009a53c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:08.831127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-26a64ca0-1d35-4b7d-8d66-ba0b0009a53c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084210 May 26 13:31:08.831705 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1042/2057] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:08 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:09.849671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c4059c5d-786c-4790-b81d-7951ab0750d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:09.850268 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c4059c5d-786c-4790-b81d-7951ab0750d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:09.857238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4059c5d-786c-4790-b81d-7951ab0750d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:09.857793 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4059c5d-786c-4790-b81d-7951ab0750d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:09.858581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4059c5d-786c-4790-b81d-7951ab0750d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:09.859102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4059c5d-786c-4790-b81d-7951ab0750d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:09.920818 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4059c5d-786c-4790-b81d-7951ab0750d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:09.929114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c4059c5d-786c-4790-b81d-7951ab0750d2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083417 May 26 13:31:09.929719 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1016/2058] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:09 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:10.948868 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-98abbdc6-745b-49a1-acb0-5de631d264c0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:10.949473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-98abbdc6-745b-49a1-acb0-5de631d264c0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:10.957029 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98abbdc6-745b-49a1-acb0-5de631d264c0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:10.957484 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98abbdc6-745b-49a1-acb0-5de631d264c0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:10.958257 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98abbdc6-745b-49a1-acb0-5de631d264c0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:10.958743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98abbdc6-745b-49a1-acb0-5de631d264c0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:11.022232 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-98abbdc6-745b-49a1-acb0-5de631d264c0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:11.029784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-98abbdc6-745b-49a1-acb0-5de631d264c0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085140 May 26 13:31:11.030469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1043/2059] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:10 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:12.047694 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f4e9dcef-d066-44fe-9f21-3914e401dfca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:12.048304 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f4e9dcef-d066-44fe-9f21-3914e401dfca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:12.055747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4e9dcef-d066-44fe-9f21-3914e401dfca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:12.056193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4e9dcef-d066-44fe-9f21-3914e401dfca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:12.056961 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4e9dcef-d066-44fe-9f21-3914e401dfca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:12.057395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4e9dcef-d066-44fe-9f21-3914e401dfca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:12.060021 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:12.123547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f4e9dcef-d066-44fe-9f21-3914e401dfca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:12.131306 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f4e9dcef-d066-44fe-9f21-3914e401dfca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087485 May 26 13:31:12.132002 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1017/2060] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:12 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:13.148412 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10ddbbce-5515-4e8f-bc9c-4f715ad6bd90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:13.149014 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10ddbbce-5515-4e8f-bc9c-4f715ad6bd90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:13.155507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10ddbbce-5515-4e8f-bc9c-4f715ad6bd90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:13.155966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10ddbbce-5515-4e8f-bc9c-4f715ad6bd90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:13.156734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10ddbbce-5515-4e8f-bc9c-4f715ad6bd90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:13.157172 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10ddbbce-5515-4e8f-bc9c-4f715ad6bd90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:13.221748 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10ddbbce-5515-4e8f-bc9c-4f715ad6bd90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:13.229592 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10ddbbce-5515-4e8f-bc9c-4f715ad6bd90 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085129 May 26 13:31:13.230152 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1044/2061] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:13 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:14.247723 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-231af944-1952-4835-aedd-9744921bbff7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:14.248367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-231af944-1952-4835-aedd-9744921bbff7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:14.256103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-231af944-1952-4835-aedd-9744921bbff7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:14.256559 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-231af944-1952-4835-aedd-9744921bbff7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:14.257342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-231af944-1952-4835-aedd-9744921bbff7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:14.257788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-231af944-1952-4835-aedd-9744921bbff7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:14.326846 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-231af944-1952-4835-aedd-9744921bbff7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:14.333042 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-231af944-1952-4835-aedd-9744921bbff7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089250 May 26 13:31:14.333606 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1018/2062] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:14 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:15.350452 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65f2813d-ec69-4433-b37d-c34cb12d348b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:15.351087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65f2813d-ec69-4433-b37d-c34cb12d348b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:15.357936 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65f2813d-ec69-4433-b37d-c34cb12d348b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:15.358405 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65f2813d-ec69-4433-b37d-c34cb12d348b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:15.359217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65f2813d-ec69-4433-b37d-c34cb12d348b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:15.359664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65f2813d-ec69-4433-b37d-c34cb12d348b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:15.422539 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-65f2813d-ec69-4433-b37d-c34cb12d348b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:15.430708 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65f2813d-ec69-4433-b37d-c34cb12d348b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084727 May 26 13:31:15.431283 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1045/2063] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:15 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:16.447347 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c080c3bf-8986-41b0-af7e-fb66bed3b33a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:16.447945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c080c3bf-8986-41b0-af7e-fb66bed3b33a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:16.454545 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c080c3bf-8986-41b0-af7e-fb66bed3b33a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:16.455001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c080c3bf-8986-41b0-af7e-fb66bed3b33a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:16.455944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c080c3bf-8986-41b0-af7e-fb66bed3b33a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:16.456429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c080c3bf-8986-41b0-af7e-fb66bed3b33a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:16.517906 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c080c3bf-8986-41b0-af7e-fb66bed3b33a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:16.527948 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c080c3bf-8986-41b0-af7e-fb66bed3b33a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083971 May 26 13:31:16.528609 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1019/2064] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:16 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:17.546084 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-74abb4d7-a713-4757-9b02-f79112547f21 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:17.546706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-74abb4d7-a713-4757-9b02-f79112547f21 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:17.554387 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74abb4d7-a713-4757-9b02-f79112547f21 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:17.554875 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74abb4d7-a713-4757-9b02-f79112547f21 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:17.555641 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74abb4d7-a713-4757-9b02-f79112547f21 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:17.556082 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74abb4d7-a713-4757-9b02-f79112547f21 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:17.617042 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-74abb4d7-a713-4757-9b02-f79112547f21 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:17.624483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-74abb4d7-a713-4757-9b02-f79112547f21 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082331 May 26 13:31:17.625047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1046/2065] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:17 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:18.642320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f0e52889-f14c-4d9b-a401-2e2205ef27e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:18.642954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f0e52889-f14c-4d9b-a401-2e2205ef27e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:18.650013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0e52889-f14c-4d9b-a401-2e2205ef27e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:18.650463 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0e52889-f14c-4d9b-a401-2e2205ef27e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:18.651260 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0e52889-f14c-4d9b-a401-2e2205ef27e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:18.651698 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0e52889-f14c-4d9b-a401-2e2205ef27e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:18.711882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f0e52889-f14c-4d9b-a401-2e2205ef27e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:18.719524 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f0e52889-f14c-4d9b-a401-2e2205ef27e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081069 May 26 13:31:18.721795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1020/2066] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:18 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:19.736396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56142ee8-9c7e-46d6-a213-cf375a9cbd01 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:19.737597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56142ee8-9c7e-46d6-a213-cf375a9cbd01 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:19.744134 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56142ee8-9c7e-46d6-a213-cf375a9cbd01 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:19.744582 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56142ee8-9c7e-46d6-a213-cf375a9cbd01 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:19.745346 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56142ee8-9c7e-46d6-a213-cf375a9cbd01 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:19.745780 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56142ee8-9c7e-46d6-a213-cf375a9cbd01 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:19.809406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56142ee8-9c7e-46d6-a213-cf375a9cbd01 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:19.817686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56142ee8-9c7e-46d6-a213-cf375a9cbd01 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085138 May 26 13:31:19.818268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1047/2067] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:19 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:20.834627 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3443504b-03b0-4ed1-9af5-44618eb1bc03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:20.835186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3443504b-03b0-4ed1-9af5-44618eb1bc03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:20.847836 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3443504b-03b0-4ed1-9af5-44618eb1bc03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:20.848299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3443504b-03b0-4ed1-9af5-44618eb1bc03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:20.849080 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3443504b-03b0-4ed1-9af5-44618eb1bc03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:20.849527 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3443504b-03b0-4ed1-9af5-44618eb1bc03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:20.912724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3443504b-03b0-4ed1-9af5-44618eb1bc03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:20.920216 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3443504b-03b0-4ed1-9af5-44618eb1bc03 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089725 May 26 13:31:20.920784 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1021/2068] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:20 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:21.937675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb72487d-102c-4867-bdab-b3be2cf41280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:21.938284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb72487d-102c-4867-bdab-b3be2cf41280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:21.945711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb72487d-102c-4867-bdab-b3be2cf41280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:21.946163 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb72487d-102c-4867-bdab-b3be2cf41280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:21.946963 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb72487d-102c-4867-bdab-b3be2cf41280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:21.947406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb72487d-102c-4867-bdab-b3be2cf41280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:22.194785 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb72487d-102c-4867-bdab-b3be2cf41280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:22.202360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb72487d-102c-4867-bdab-b3be2cf41280 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.268573 May 26 13:31:22.202952 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1048/2069] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:21 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:23.219170 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31a26324-30b1-4499-82d2-6d825d6639ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:23.219786 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31a26324-30b1-4499-82d2-6d825d6639ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:23.226989 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31a26324-30b1-4499-82d2-6d825d6639ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:23.227446 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31a26324-30b1-4499-82d2-6d825d6639ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:23.228473 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31a26324-30b1-4499-82d2-6d825d6639ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:23.228913 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31a26324-30b1-4499-82d2-6d825d6639ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:23.344255 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31a26324-30b1-4499-82d2-6d825d6639ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:23.352342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31a26324-30b1-4499-82d2-6d825d6639ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.137077 May 26 13:31:23.352903 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1022/2070] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:23 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:24.369480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d42264c3-646d-4fe9-8fa2-c42add629621 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:24.370018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d42264c3-646d-4fe9-8fa2-c42add629621 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:24.376136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42264c3-646d-4fe9-8fa2-c42add629621 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:24.376597 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42264c3-646d-4fe9-8fa2-c42add629621 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:24.377371 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42264c3-646d-4fe9-8fa2-c42add629621 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:24.377814 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42264c3-646d-4fe9-8fa2-c42add629621 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:24.438560 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d42264c3-646d-4fe9-8fa2-c42add629621 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:24.446668 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d42264c3-646d-4fe9-8fa2-c42add629621 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081240 May 26 13:31:24.447229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1049/2071] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:24 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:25.463556 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b065ccc4-3953-47fa-8d23-df6dbb537b0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:25.464301 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b065ccc4-3953-47fa-8d23-df6dbb537b0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:25.471008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b065ccc4-3953-47fa-8d23-df6dbb537b0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:25.471701 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b065ccc4-3953-47fa-8d23-df6dbb537b0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:25.472479 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b065ccc4-3953-47fa-8d23-df6dbb537b0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:25.472926 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b065ccc4-3953-47fa-8d23-df6dbb537b0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:25.535097 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b065ccc4-3953-47fa-8d23-df6dbb537b0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:25.542726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b065ccc4-3953-47fa-8d23-df6dbb537b0d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082952 May 26 13:31:25.543305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1023/2072] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:25 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:26.559821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-16cbb2d5-f642-4d75-a061-651954aae189 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:26.560432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-16cbb2d5-f642-4d75-a061-651954aae189 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:26.568310 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16cbb2d5-f642-4d75-a061-651954aae189 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:26.568771 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16cbb2d5-f642-4d75-a061-651954aae189 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:26.569552 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16cbb2d5-f642-4d75-a061-651954aae189 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:26.569995 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16cbb2d5-f642-4d75-a061-651954aae189 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:26.634918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-16cbb2d5-f642-4d75-a061-651954aae189 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:26.642942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-16cbb2d5-f642-4d75-a061-651954aae189 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086855 May 26 13:31:26.643540 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1050/2073] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:26 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:27.659887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc211173-45dc-416f-8372-a766a697a19c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:27.660539 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc211173-45dc-416f-8372-a766a697a19c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:27.667083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc211173-45dc-416f-8372-a766a697a19c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:27.667537 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc211173-45dc-416f-8372-a766a697a19c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:27.668312 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc211173-45dc-416f-8372-a766a697a19c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:27.668756 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc211173-45dc-416f-8372-a766a697a19c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:27.730117 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc211173-45dc-416f-8372-a766a697a19c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:27.737649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc211173-45dc-416f-8372-a766a697a19c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081738 May 26 13:31:27.738279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1024/2074] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:27 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:28.754119 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5334f11-6251-474b-badc-08e7006d7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:28.754758 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5334f11-6251-474b-badc-08e7006d7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:28.761369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5334f11-6251-474b-badc-08e7006d7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:28.761820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5334f11-6251-474b-badc-08e7006d7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:28.762595 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5334f11-6251-474b-badc-08e7006d7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:28.763028 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5334f11-6251-474b-badc-08e7006d7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:28.826069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5334f11-6251-474b-badc-08e7006d7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:28.834204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5334f11-6251-474b-badc-08e7006d7419 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083820 May 26 13:31:28.834805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1051/2075] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:28 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:29.851409 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6a4085be-b43b-4fa1-bbb8-8dadc7a28054 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:29.852027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6a4085be-b43b-4fa1-bbb8-8dadc7a28054 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:29.858816 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a4085be-b43b-4fa1-bbb8-8dadc7a28054 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:29.859278 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a4085be-b43b-4fa1-bbb8-8dadc7a28054 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:29.860048 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a4085be-b43b-4fa1-bbb8-8dadc7a28054 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:29.860492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a4085be-b43b-4fa1-bbb8-8dadc7a28054 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:29.926468 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6a4085be-b43b-4fa1-bbb8-8dadc7a28054 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:29.933968 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6a4085be-b43b-4fa1-bbb8-8dadc7a28054 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086715 May 26 13:31:29.934540 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1025/2076] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:29 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:30.951652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-351c09bd-5a36-430b-88ac-a1e06760da08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:30.952258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-351c09bd-5a36-430b-88ac-a1e06760da08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:30.959656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-351c09bd-5a36-430b-88ac-a1e06760da08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:30.960106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-351c09bd-5a36-430b-88ac-a1e06760da08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:30.960864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-351c09bd-5a36-430b-88ac-a1e06760da08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:30.961300 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-351c09bd-5a36-430b-88ac-a1e06760da08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:31.024778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-351c09bd-5a36-430b-88ac-a1e06760da08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:31.032414 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-351c09bd-5a36-430b-88ac-a1e06760da08 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084614 May 26 13:31:31.033007 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1052/2077] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:30 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:32.049359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-61c734dd-9d62-44f9-8834-be2fd85ce544 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:32.050584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-61c734dd-9d62-44f9-8834-be2fd85ce544 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:32.057298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61c734dd-9d62-44f9-8834-be2fd85ce544 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:32.057799 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61c734dd-9d62-44f9-8834-be2fd85ce544 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:32.058607 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61c734dd-9d62-44f9-8834-be2fd85ce544 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:32.059068 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61c734dd-9d62-44f9-8834-be2fd85ce544 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:32.121363 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61c734dd-9d62-44f9-8834-be2fd85ce544 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:32.129148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-61c734dd-9d62-44f9-8834-be2fd85ce544 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083632 May 26 13:31:32.129959 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1026/2078] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:32 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:33.147443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-caa760b0-a4b2-44ee-8541-fb4102c4b556 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:33.148074 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-caa760b0-a4b2-44ee-8541-fb4102c4b556 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:33.154648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-caa760b0-a4b2-44ee-8541-fb4102c4b556 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:33.155109 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-caa760b0-a4b2-44ee-8541-fb4102c4b556 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:33.155863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-caa760b0-a4b2-44ee-8541-fb4102c4b556 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:33.156304 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-caa760b0-a4b2-44ee-8541-fb4102c4b556 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:33.216520 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-caa760b0-a4b2-44ee-8541-fb4102c4b556 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:33.225365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-caa760b0-a4b2-44ee-8541-fb4102c4b556 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082717 May 26 13:31:33.225938 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1053/2079] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:33 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:34.242494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2808db05-644c-492d-89f2-180ec3d08797 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:34.243118 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2808db05-644c-492d-89f2-180ec3d08797 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:34.249866 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2808db05-644c-492d-89f2-180ec3d08797 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:34.250317 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2808db05-644c-492d-89f2-180ec3d08797 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:34.251280 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2808db05-644c-492d-89f2-180ec3d08797 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:34.251721 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2808db05-644c-492d-89f2-180ec3d08797 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:34.315551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2808db05-644c-492d-89f2-180ec3d08797 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:34.323983 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2808db05-644c-492d-89f2-180ec3d08797 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085336 May 26 13:31:34.324480 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1027/2080] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:34 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:35.341330 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b79dbf21-6e14-4c08-a5eb-db05ab363bc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:35.341990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b79dbf21-6e14-4c08-a5eb-db05ab363bc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:35.348827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b79dbf21-6e14-4c08-a5eb-db05ab363bc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:35.349277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b79dbf21-6e14-4c08-a5eb-db05ab363bc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:35.350071 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b79dbf21-6e14-4c08-a5eb-db05ab363bc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:35.350503 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b79dbf21-6e14-4c08-a5eb-db05ab363bc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:35.413419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b79dbf21-6e14-4c08-a5eb-db05ab363bc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:35.421400 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b79dbf21-6e14-4c08-a5eb-db05ab363bc3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083865 May 26 13:31:35.421973 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1054/2081] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:35 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:36.439697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb2b4ce8-ce83-4a4a-841c-53ef4e7f1101 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:36.440313 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb2b4ce8-ce83-4a4a-841c-53ef4e7f1101 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:36.447901 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2b4ce8-ce83-4a4a-841c-53ef4e7f1101 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:36.448393 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2b4ce8-ce83-4a4a-841c-53ef4e7f1101 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:36.449226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2b4ce8-ce83-4a4a-841c-53ef4e7f1101 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:36.449712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2b4ce8-ce83-4a4a-841c-53ef4e7f1101 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:36.512263 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bb2b4ce8-ce83-4a4a-841c-53ef4e7f1101 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:36.519885 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb2b4ce8-ce83-4a4a-841c-53ef4e7f1101 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084150 May 26 13:31:36.520630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1028/2082] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:36 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:37.537321 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b05a1e62-2c2c-4814-8fc6-eaafff6a762d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:37.537898 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b05a1e62-2c2c-4814-8fc6-eaafff6a762d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:37.540226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:37.545050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b05a1e62-2c2c-4814-8fc6-eaafff6a762d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:37.545509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b05a1e62-2c2c-4814-8fc6-eaafff6a762d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:37.546279 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b05a1e62-2c2c-4814-8fc6-eaafff6a762d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:37.546841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b05a1e62-2c2c-4814-8fc6-eaafff6a762d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:37.611051 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b05a1e62-2c2c-4814-8fc6-eaafff6a762d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:37.619259 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b05a1e62-2c2c-4814-8fc6-eaafff6a762d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086096 May 26 13:31:37.619824 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1055/2083] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:37 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:38.636054 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b517186f-8c13-474d-9b19-4a955859b654 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:38.636684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b517186f-8c13-474d-9b19-4a955859b654 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:38.639201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:38.644087 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b517186f-8c13-474d-9b19-4a955859b654 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:38.645057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b517186f-8c13-474d-9b19-4a955859b654 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:38.646639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b517186f-8c13-474d-9b19-4a955859b654 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:38.653535 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b517186f-8c13-474d-9b19-4a955859b654 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:38.712598 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b517186f-8c13-474d-9b19-4a955859b654 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:38.720174 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b517186f-8c13-474d-9b19-4a955859b654 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087963 May 26 13:31:38.720735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1029/2084] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:38 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:39.738170 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48b6e9c6-c93a-414a-8672-fd37db32a68f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:39.738885 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-48b6e9c6-c93a-414a-8672-fd37db32a68f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:39.745563 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48b6e9c6-c93a-414a-8672-fd37db32a68f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:39.746022 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48b6e9c6-c93a-414a-8672-fd37db32a68f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:39.746827 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48b6e9c6-c93a-414a-8672-fd37db32a68f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:39.747270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48b6e9c6-c93a-414a-8672-fd37db32a68f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:39.810369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-48b6e9c6-c93a-414a-8672-fd37db32a68f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:39.818045 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48b6e9c6-c93a-414a-8672-fd37db32a68f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083736 May 26 13:31:39.818636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1056/2085] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:39 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:40.835101 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd06c589-0197-4064-8b60-8af6e65a501b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:40.835742 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd06c589-0197-4064-8b60-8af6e65a501b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:40.842233 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd06c589-0197-4064-8b60-8af6e65a501b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:40.842740 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd06c589-0197-4064-8b60-8af6e65a501b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:40.843512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd06c589-0197-4064-8b60-8af6e65a501b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:40.843943 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd06c589-0197-4064-8b60-8af6e65a501b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:40.906302 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd06c589-0197-4064-8b60-8af6e65a501b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:40.913940 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd06c589-0197-4064-8b60-8af6e65a501b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082989 May 26 13:31:40.914502 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1030/2086] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:40 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:41.930949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17244df6-a45d-45a7-b52b-00cda525cd1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:41.931587 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17244df6-a45d-45a7-b52b-00cda525cd1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:41.938215 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17244df6-a45d-45a7-b52b-00cda525cd1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:41.938625 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17244df6-a45d-45a7-b52b-00cda525cd1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:41.939385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17244df6-a45d-45a7-b52b-00cda525cd1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:41.939818 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17244df6-a45d-45a7-b52b-00cda525cd1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:41.943204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=90 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:42.004979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-17244df6-a45d-45a7-b52b-00cda525cd1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:42.012437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17244df6-a45d-45a7-b52b-00cda525cd1b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085559 May 26 13:31:42.013010 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1057/2087] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:41 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:43.029795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2338ad5a-a353-4e41-9296-699ffebe63da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:43.030515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2338ad5a-a353-4e41-9296-699ffebe63da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:43.038245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2338ad5a-a353-4e41-9296-699ffebe63da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:43.038735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2338ad5a-a353-4e41-9296-699ffebe63da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:43.039520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2338ad5a-a353-4e41-9296-699ffebe63da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:43.039962 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2338ad5a-a353-4e41-9296-699ffebe63da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:43.042735 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:43.103917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2338ad5a-a353-4e41-9296-699ffebe63da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:43.111298 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2338ad5a-a353-4e41-9296-699ffebe63da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085337 May 26 13:31:43.111855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1031/2088] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:43 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:31:44.128062 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f11f8e7c-4326-42b6-ac53-493d9829ed96 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:44.128842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f11f8e7c-4326-42b6-ac53-493d9829ed96 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:44.136220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f11f8e7c-4326-42b6-ac53-493d9829ed96 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:44.140954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f11f8e7c-4326-42b6-ac53-493d9829ed96 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:44.140954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f11f8e7c-4326-42b6-ac53-493d9829ed96 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:44.140954 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f11f8e7c-4326-42b6-ac53-493d9829ed96 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:44.200446 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f11f8e7c-4326-42b6-ac53-493d9829ed96 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:44.208684 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f11f8e7c-4326-42b6-ac53-493d9829ed96 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083883 May 26 13:31:44.209266 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1058/2089] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:44 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:45.226547 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0f5e8ee6-89e9-45eb-82e2-fae9a4f0b73f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:45.227234 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0f5e8ee6-89e9-45eb-82e2-fae9a4f0b73f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:45.234151 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f5e8ee6-89e9-45eb-82e2-fae9a4f0b73f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:45.234643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f5e8ee6-89e9-45eb-82e2-fae9a4f0b73f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:45.235441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f5e8ee6-89e9-45eb-82e2-fae9a4f0b73f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:45.235876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f5e8ee6-89e9-45eb-82e2-fae9a4f0b73f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:45.298073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0f5e8ee6-89e9-45eb-82e2-fae9a4f0b73f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:45.305871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f5e8ee6-89e9-45eb-82e2-fae9a4f0b73f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084365 May 26 13:31:45.306442 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1032/2090] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:45 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:46.323296 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7173b04e-8ae1-4f30-b216-47086bffc7ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:46.323996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7173b04e-8ae1-4f30-b216-47086bffc7ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:46.330645 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7173b04e-8ae1-4f30-b216-47086bffc7ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:46.331104 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7173b04e-8ae1-4f30-b216-47086bffc7ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:46.331879 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7173b04e-8ae1-4f30-b216-47086bffc7ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:46.332318 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7173b04e-8ae1-4f30-b216-47086bffc7ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:46.407018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7173b04e-8ae1-4f30-b216-47086bffc7ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:46.415556 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7173b04e-8ae1-4f30-b216-47086bffc7ad tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.096339 May 26 13:31:46.416612 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1059/2091] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:46 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:47.433432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-02663eb8-2341-497a-b550-1815b7dedf4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:47.434040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-02663eb8-2341-497a-b550-1815b7dedf4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:47.440668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02663eb8-2341-497a-b550-1815b7dedf4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:47.441120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02663eb8-2341-497a-b550-1815b7dedf4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:47.441881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02663eb8-2341-497a-b550-1815b7dedf4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:47.442318 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02663eb8-2341-497a-b550-1815b7dedf4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:47.508406 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02663eb8-2341-497a-b550-1815b7dedf4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:47.515941 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-02663eb8-2341-497a-b550-1815b7dedf4f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086377 May 26 13:31:47.516506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1033/2092] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:47 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:48.533469 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02b4c339-13d4-4c83-8f3f-4deca9f772b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:48.534138 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02b4c339-13d4-4c83-8f3f-4deca9f772b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:48.543361 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02b4c339-13d4-4c83-8f3f-4deca9f772b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:48.546447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02b4c339-13d4-4c83-8f3f-4deca9f772b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:48.546447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02b4c339-13d4-4c83-8f3f-4deca9f772b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:48.546447 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02b4c339-13d4-4c83-8f3f-4deca9f772b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:48.611272 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02b4c339-13d4-4c83-8f3f-4deca9f772b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:48.620124 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02b4c339-13d4-4c83-8f3f-4deca9f772b3 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090485 May 26 13:31:48.620713 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1060/2093] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:48 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:49.637270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-22fd7998-b973-40e1-bf09-dbd10b5720e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:49.638272 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-22fd7998-b973-40e1-bf09-dbd10b5720e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:49.644154 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22fd7998-b973-40e1-bf09-dbd10b5720e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:49.644604 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22fd7998-b973-40e1-bf09-dbd10b5720e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:49.645369 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22fd7998-b973-40e1-bf09-dbd10b5720e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:49.645805 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22fd7998-b973-40e1-bf09-dbd10b5720e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:49.706040 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22fd7998-b973-40e1-bf09-dbd10b5720e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:49.713508 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-22fd7998-b973-40e1-bf09-dbd10b5720e8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080188 May 26 13:31:49.714070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1034/2094] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:49 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:50.730863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a8f8831-967d-4e29-9593-930c1e2f3197 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:50.731467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a8f8831-967d-4e29-9593-930c1e2f3197 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:50.738132 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a8f8831-967d-4e29-9593-930c1e2f3197 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:50.738615 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a8f8831-967d-4e29-9593-930c1e2f3197 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:50.739384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a8f8831-967d-4e29-9593-930c1e2f3197 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:50.739825 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a8f8831-967d-4e29-9593-930c1e2f3197 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:50.800034 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a8f8831-967d-4e29-9593-930c1e2f3197 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:50.809855 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a8f8831-967d-4e29-9593-930c1e2f3197 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082884 May 26 13:31:50.810913 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1061/2095] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:50 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:51.829685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-efb4330e-895e-4cf8-a0f8-532029922682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:51.830839 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-efb4330e-895e-4cf8-a0f8-532029922682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:51.841400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efb4330e-895e-4cf8-a0f8-532029922682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:51.842132 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efb4330e-895e-4cf8-a0f8-532029922682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:51.843043 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efb4330e-895e-4cf8-a0f8-532029922682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:51.843490 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efb4330e-895e-4cf8-a0f8-532029922682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:51.912979 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-efb4330e-895e-4cf8-a0f8-532029922682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:51.921051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-efb4330e-895e-4cf8-a0f8-532029922682 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.096227 May 26 13:31:51.921625 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1035/2096] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:51 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:52.937633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e8fba2e9-7900-40a1-aa1e-2535bd89b2ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:52.938235 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e8fba2e9-7900-40a1-aa1e-2535bd89b2ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:52.944494 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8fba2e9-7900-40a1-aa1e-2535bd89b2ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:52.945054 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8fba2e9-7900-40a1-aa1e-2535bd89b2ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:52.945834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8fba2e9-7900-40a1-aa1e-2535bd89b2ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:52.946277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8fba2e9-7900-40a1-aa1e-2535bd89b2ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:53.006322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e8fba2e9-7900-40a1-aa1e-2535bd89b2ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:53.014383 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e8fba2e9-7900-40a1-aa1e-2535bd89b2ea tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080648 May 26 13:31:53.014983 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1062/2097] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:52 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:53.399176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:31:53.399463 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:31:54.032046 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e023d8fd-9ee9-460b-929a-389212dba612 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:54.033113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e023d8fd-9ee9-460b-929a-389212dba612 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:54.040975 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e023d8fd-9ee9-460b-929a-389212dba612 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:54.041424 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e023d8fd-9ee9-460b-929a-389212dba612 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:54.042196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e023d8fd-9ee9-460b-929a-389212dba612 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:54.042666 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e023d8fd-9ee9-460b-929a-389212dba612 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:54.108688 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e023d8fd-9ee9-460b-929a-389212dba612 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:54.116279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e023d8fd-9ee9-460b-929a-389212dba612 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088611 May 26 13:31:54.117430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1036/2098] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:54 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:55.135363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a674137-938d-4f19-8dac-82d838912032 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:55.136000 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a674137-938d-4f19-8dac-82d838912032 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:55.142610 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a674137-938d-4f19-8dac-82d838912032 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:55.143064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a674137-938d-4f19-8dac-82d838912032 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:55.143836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a674137-938d-4f19-8dac-82d838912032 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:55.144279 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a674137-938d-4f19-8dac-82d838912032 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:55.209828 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a674137-938d-4f19-8dac-82d838912032 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:55.218024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a674137-938d-4f19-8dac-82d838912032 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087019 May 26 13:31:55.218605 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1063/2099] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:55 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:56.237725 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f53f6da-b079-4711-afa6-71d7aa8ebf99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:56.238348 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f53f6da-b079-4711-afa6-71d7aa8ebf99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:56.246103 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f53f6da-b079-4711-afa6-71d7aa8ebf99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:56.246587 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f53f6da-b079-4711-afa6-71d7aa8ebf99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:56.247418 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f53f6da-b079-4711-afa6-71d7aa8ebf99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:56.247857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f53f6da-b079-4711-afa6-71d7aa8ebf99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:56.314062 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f53f6da-b079-4711-afa6-71d7aa8ebf99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:56.322340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f53f6da-b079-4711-afa6-71d7aa8ebf99 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090587 May 26 13:31:56.322920 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1037/2100] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:56 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:57.339722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6ccbb46b-ae3e-49b6-8e4e-9ddc5a22bf8e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:57.340337 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6ccbb46b-ae3e-49b6-8e4e-9ddc5a22bf8e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:57.346841 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ccbb46b-ae3e-49b6-8e4e-9ddc5a22bf8e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:57.347295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ccbb46b-ae3e-49b6-8e4e-9ddc5a22bf8e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:57.348060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ccbb46b-ae3e-49b6-8e4e-9ddc5a22bf8e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:57.348500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ccbb46b-ae3e-49b6-8e4e-9ddc5a22bf8e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:57.411441 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6ccbb46b-ae3e-49b6-8e4e-9ddc5a22bf8e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:57.419994 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6ccbb46b-ae3e-49b6-8e4e-9ddc5a22bf8e tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084668 May 26 13:31:57.424668 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1064/2101] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:57 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:58.437591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dfdebcf0-eaa1-49e4-92d2-b716a49d4749 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:58.438210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dfdebcf0-eaa1-49e4-92d2-b716a49d4749 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:58.445116 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfdebcf0-eaa1-49e4-92d2-b716a49d4749 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:58.445734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfdebcf0-eaa1-49e4-92d2-b716a49d4749 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:58.447119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfdebcf0-eaa1-49e4-92d2-b716a49d4749 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:58.447564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfdebcf0-eaa1-49e4-92d2-b716a49d4749 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:58.507923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dfdebcf0-eaa1-49e4-92d2-b716a49d4749 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:58.516669 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dfdebcf0-eaa1-49e4-92d2-b716a49d4749 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083009 May 26 13:31:58.517513 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1038/2102] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:58 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:31:59.534096 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09f03441-fc23-495d-b600-6fb8b6643ef8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:31:59.534719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09f03441-fc23-495d-b600-6fb8b6643ef8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:31:59.541967 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09f03441-fc23-495d-b600-6fb8b6643ef8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:59.542415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09f03441-fc23-495d-b600-6fb8b6643ef8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:59.543258 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09f03441-fc23-495d-b600-6fb8b6643ef8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:31:59.543693 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09f03441-fc23-495d-b600-6fb8b6643ef8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:31:59.604754 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-09f03441-fc23-495d-b600-6fb8b6643ef8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:31:59.612213 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09f03441-fc23-495d-b600-6fb8b6643ef8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082256 May 26 13:31:59.612777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1065/2103] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:31:59 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:00.629497 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e719efb4-593f-4894-a3be-97119325f169 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:00.630113 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e719efb4-593f-4894-a3be-97119325f169 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:00.637134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e719efb4-593f-4894-a3be-97119325f169 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:00.637590 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e719efb4-593f-4894-a3be-97119325f169 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:00.638358 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e719efb4-593f-4894-a3be-97119325f169 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:00.638832 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e719efb4-593f-4894-a3be-97119325f169 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:00.701997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e719efb4-593f-4894-a3be-97119325f169 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:00.709498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e719efb4-593f-4894-a3be-97119325f169 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083954 May 26 13:32:00.710057 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1039/2104] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:00 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:01.725480 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-95a145be-601b-4eee-a7ee-076c8401d0ba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:01.726078 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-95a145be-601b-4eee-a7ee-076c8401d0ba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:01.733177 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95a145be-601b-4eee-a7ee-076c8401d0ba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:01.733628 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95a145be-601b-4eee-a7ee-076c8401d0ba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:01.734384 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95a145be-601b-4eee-a7ee-076c8401d0ba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:01.734848 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95a145be-601b-4eee-a7ee-076c8401d0ba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:01.797269 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-95a145be-601b-4eee-a7ee-076c8401d0ba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:01.804722 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-95a145be-601b-4eee-a7ee-076c8401d0ba tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083080 May 26 13:32:01.805290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1066/2105] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:01 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:02.821899 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-002575da-b3fa-4ab1-bb68-ed7ec548449b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:02.823258 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-002575da-b3fa-4ab1-bb68-ed7ec548449b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:02.829851 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-002575da-b3fa-4ab1-bb68-ed7ec548449b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:02.830305 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-002575da-b3fa-4ab1-bb68-ed7ec548449b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:02.831100 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-002575da-b3fa-4ab1-bb68-ed7ec548449b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:02.831543 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-002575da-b3fa-4ab1-bb68-ed7ec548449b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:02.893470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-002575da-b3fa-4ab1-bb68-ed7ec548449b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:02.902076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-002575da-b3fa-4ab1-bb68-ed7ec548449b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083931 May 26 13:32:02.903087 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1040/2106] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:02 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:03.919750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8fbe1baa-6e9e-44ca-b847-d0fc39ac6956 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:03.920367 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8fbe1baa-6e9e-44ca-b847-d0fc39ac6956 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:03.927360 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8fbe1baa-6e9e-44ca-b847-d0fc39ac6956 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:03.927807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8fbe1baa-6e9e-44ca-b847-d0fc39ac6956 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:03.928577 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8fbe1baa-6e9e-44ca-b847-d0fc39ac6956 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:03.929009 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8fbe1baa-6e9e-44ca-b847-d0fc39ac6956 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:03.995514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8fbe1baa-6e9e-44ca-b847-d0fc39ac6956 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:04.002950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8fbe1baa-6e9e-44ca-b847-d0fc39ac6956 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088044 May 26 13:32:04.003521 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1067/2107] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:03 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:05.019708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-69e488bd-f652-4b4e-bc44-17dbdcc4b0a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:05.020446 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-69e488bd-f652-4b4e-bc44-17dbdcc4b0a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:05.027312 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69e488bd-f652-4b4e-bc44-17dbdcc4b0a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:05.027767 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69e488bd-f652-4b4e-bc44-17dbdcc4b0a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:05.028538 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69e488bd-f652-4b4e-bc44-17dbdcc4b0a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:05.028980 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69e488bd-f652-4b4e-bc44-17dbdcc4b0a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:05.093883 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-69e488bd-f652-4b4e-bc44-17dbdcc4b0a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:05.101512 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-69e488bd-f652-4b4e-bc44-17dbdcc4b0a5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085735 May 26 13:32:05.102083 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1041/2108] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:05 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:06.119804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2142cdfb-968f-46bd-aaae-2d1ca7eebdbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:06.120454 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2142cdfb-968f-46bd-aaae-2d1ca7eebdbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:06.127530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2142cdfb-968f-46bd-aaae-2d1ca7eebdbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:06.127986 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2142cdfb-968f-46bd-aaae-2d1ca7eebdbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:06.128756 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2142cdfb-968f-46bd-aaae-2d1ca7eebdbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:06.129194 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2142cdfb-968f-46bd-aaae-2d1ca7eebdbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:06.191483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2142cdfb-968f-46bd-aaae-2d1ca7eebdbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:06.199662 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2142cdfb-968f-46bd-aaae-2d1ca7eebdbb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084362 May 26 13:32:06.200220 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1068/2109] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:06 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:07.217262 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-84554384-3627-437d-9a0d-de853b46eb74 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:07.217878 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-84554384-3627-437d-9a0d-de853b46eb74 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:07.224498 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84554384-3627-437d-9a0d-de853b46eb74 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:07.224937 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84554384-3627-437d-9a0d-de853b46eb74 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:07.225703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84554384-3627-437d-9a0d-de853b46eb74 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:07.226149 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84554384-3627-437d-9a0d-de853b46eb74 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:07.296577 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84554384-3627-437d-9a0d-de853b46eb74 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:07.304915 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-84554384-3627-437d-9a0d-de853b46eb74 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092217 May 26 13:32:07.305494 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1042/2110] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:07 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:08.322373 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d8a06053-e6df-4f79-9f27-b6292811af3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:08.323295 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d8a06053-e6df-4f79-9f27-b6292811af3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:08.325613 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:08.330341 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8a06053-e6df-4f79-9f27-b6292811af3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:08.330839 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8a06053-e6df-4f79-9f27-b6292811af3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:08.331602 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8a06053-e6df-4f79-9f27-b6292811af3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:08.332041 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8a06053-e6df-4f79-9f27-b6292811af3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:08.393832 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d8a06053-e6df-4f79-9f27-b6292811af3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:08.403001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d8a06053-e6df-4f79-9f27-b6292811af3b tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084267 May 26 13:32:08.403588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1069/2111] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:08 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:09.420256 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d9fd4d4d-f633-44af-8979-46bfa8d52446 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:09.420878 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d9fd4d4d-f633-44af-8979-46bfa8d52446 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:09.423248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:09.428106 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9fd4d4d-f633-44af-8979-46bfa8d52446 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:09.428567 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9fd4d4d-f633-44af-8979-46bfa8d52446 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:09.429365 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9fd4d4d-f633-44af-8979-46bfa8d52446 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:09.429815 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9fd4d4d-f633-44af-8979-46bfa8d52446 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:09.500911 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9fd4d4d-f633-44af-8979-46bfa8d52446 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:09.508641 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d9fd4d4d-f633-44af-8979-46bfa8d52446 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092915 May 26 13:32:09.509295 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1043/2112] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:09 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:32:10.525195 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-673add3e-f1c4-49ae-b50a-106bf3073c8d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:10.525901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-673add3e-f1c4-49ae-b50a-106bf3073c8d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:10.532453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-673add3e-f1c4-49ae-b50a-106bf3073c8d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:10.532894 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-673add3e-f1c4-49ae-b50a-106bf3073c8d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:10.533650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-673add3e-f1c4-49ae-b50a-106bf3073c8d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:10.534079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-673add3e-f1c4-49ae-b50a-106bf3073c8d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:10.594864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-673add3e-f1c4-49ae-b50a-106bf3073c8d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:10.602588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-673add3e-f1c4-49ae-b50a-106bf3073c8d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081136 May 26 13:32:10.603161 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1070/2113] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:10 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:11.624050 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2d09684-63f7-4eba-97f3-61fa4ed207f0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:11.624711 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2d09684-63f7-4eba-97f3-61fa4ed207f0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:11.631969 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2d09684-63f7-4eba-97f3-61fa4ed207f0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:11.632619 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2d09684-63f7-4eba-97f3-61fa4ed207f0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:11.634009 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2d09684-63f7-4eba-97f3-61fa4ed207f0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:11.634929 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2d09684-63f7-4eba-97f3-61fa4ed207f0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:11.705394 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2d09684-63f7-4eba-97f3-61fa4ed207f0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:11.712998 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2d09684-63f7-4eba-97f3-61fa4ed207f0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092860 May 26 13:32:11.714250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1044/2114] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:11 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:12.731219 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d4620a7-2252-4505-8c5c-df0bd1dbdaff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:12.731831 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d4620a7-2252-4505-8c5c-df0bd1dbdaff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:12.738478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d4620a7-2252-4505-8c5c-df0bd1dbdaff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:12.738960 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d4620a7-2252-4505-8c5c-df0bd1dbdaff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:12.739727 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d4620a7-2252-4505-8c5c-df0bd1dbdaff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:12.740168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d4620a7-2252-4505-8c5c-df0bd1dbdaff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:12.744030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:12.803502 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7d4620a7-2252-4505-8c5c-df0bd1dbdaff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:12.811770 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d4620a7-2252-4505-8c5c-df0bd1dbdaff tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084964 May 26 13:32:12.812335 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1071/2115] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:12 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:13.829591 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-44db5dcd-4e3e-4057-a6e2-480c27e3c820 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:13.830225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-44db5dcd-4e3e-4057-a6e2-480c27e3c820 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:13.837011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44db5dcd-4e3e-4057-a6e2-480c27e3c820 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:13.837459 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44db5dcd-4e3e-4057-a6e2-480c27e3c820 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:13.838791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44db5dcd-4e3e-4057-a6e2-480c27e3c820 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:13.839448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44db5dcd-4e3e-4057-a6e2-480c27e3c820 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:13.841918 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:13.905978 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-44db5dcd-4e3e-4057-a6e2-480c27e3c820 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:13.913795 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-44db5dcd-4e3e-4057-a6e2-480c27e3c820 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088074 May 26 13:32:13.914382 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1045/2116] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:13 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:14.930784 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a41d6732-0d98-4614-b425-b252b7cdb746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:14.931392 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a41d6732-0d98-4614-b425-b252b7cdb746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:14.937971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a41d6732-0d98-4614-b425-b252b7cdb746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:14.938423 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a41d6732-0d98-4614-b425-b252b7cdb746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:14.939205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a41d6732-0d98-4614-b425-b252b7cdb746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:14.939642 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a41d6732-0d98-4614-b425-b252b7cdb746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:15.003290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a41d6732-0d98-4614-b425-b252b7cdb746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:15.011371 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a41d6732-0d98-4614-b425-b252b7cdb746 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084553 May 26 13:32:15.011930 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1072/2117] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:14 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:16.028434 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8918458-c75b-485a-afee-48eff580f5ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:16.029758 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8918458-c75b-485a-afee-48eff580f5ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:16.037229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8918458-c75b-485a-afee-48eff580f5ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:16.037685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8918458-c75b-485a-afee-48eff580f5ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:16.038470 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8918458-c75b-485a-afee-48eff580f5ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:16.038935 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8918458-c75b-485a-afee-48eff580f5ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:16.105692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b8918458-c75b-485a-afee-48eff580f5ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:16.113636 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8918458-c75b-485a-afee-48eff580f5ca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089528 May 26 13:32:16.114210 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1046/2118] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:16 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:17.130917 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-329e79be-3101-4898-868c-993390b110c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:17.131528 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-329e79be-3101-4898-868c-993390b110c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:17.138015 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-329e79be-3101-4898-868c-993390b110c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:17.138761 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-329e79be-3101-4898-868c-993390b110c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:17.139412 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-329e79be-3101-4898-868c-993390b110c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:17.139883 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-329e79be-3101-4898-868c-993390b110c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:17.203026 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-329e79be-3101-4898-868c-993390b110c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:17.210884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-329e79be-3101-4898-868c-993390b110c4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084037 May 26 13:32:17.211458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1073/2119] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:17 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:18.227651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fa67b352-321d-410b-9b68-8e7a2ec9ac4d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:18.228270 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fa67b352-321d-410b-9b68-8e7a2ec9ac4d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:18.236005 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa67b352-321d-410b-9b68-8e7a2ec9ac4d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:18.236462 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa67b352-321d-410b-9b68-8e7a2ec9ac4d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:18.237266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa67b352-321d-410b-9b68-8e7a2ec9ac4d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:18.237712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa67b352-321d-410b-9b68-8e7a2ec9ac4d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:18.300631 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fa67b352-321d-410b-9b68-8e7a2ec9ac4d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:18.308441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fa67b352-321d-410b-9b68-8e7a2ec9ac4d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084743 May 26 13:32:18.309009 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1047/2120] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:18 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:19.326807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-823ab048-8919-4c93-8bcc-6cb65e00b985 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:19.327415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-823ab048-8919-4c93-8bcc-6cb65e00b985 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:19.333842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-823ab048-8919-4c93-8bcc-6cb65e00b985 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:19.334287 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-823ab048-8919-4c93-8bcc-6cb65e00b985 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:19.335077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-823ab048-8919-4c93-8bcc-6cb65e00b985 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:19.335510 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-823ab048-8919-4c93-8bcc-6cb65e00b985 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:19.398218 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-823ab048-8919-4c93-8bcc-6cb65e00b985 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:19.406566 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-823ab048-8919-4c93-8bcc-6cb65e00b985 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084136 May 26 13:32:19.407175 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1074/2121] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:19 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:20.424297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e664aa9f-fe23-4484-a43f-be119281c313 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:20.424909 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e664aa9f-fe23-4484-a43f-be119281c313 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:20.430918 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e664aa9f-fe23-4484-a43f-be119281c313 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:20.431366 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e664aa9f-fe23-4484-a43f-be119281c313 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:20.432119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e664aa9f-fe23-4484-a43f-be119281c313 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:20.432555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e664aa9f-fe23-4484-a43f-be119281c313 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:20.493051 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e664aa9f-fe23-4484-a43f-be119281c313 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:20.500737 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e664aa9f-fe23-4484-a43f-be119281c313 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081038 May 26 13:32:20.501297 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1048/2122] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:20 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:21.681094 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fec2e512-006e-402c-8718-82cad4c158b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:21.681703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fec2e512-006e-402c-8718-82cad4c158b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:21.688854 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fec2e512-006e-402c-8718-82cad4c158b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:21.689305 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fec2e512-006e-402c-8718-82cad4c158b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:21.690319 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fec2e512-006e-402c-8718-82cad4c158b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:21.690836 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fec2e512-006e-402c-8718-82cad4c158b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:21.755664 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fec2e512-006e-402c-8718-82cad4c158b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:21.763128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fec2e512-006e-402c-8718-82cad4c158b5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.249517 May 26 13:32:21.763813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1075/2123] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:21 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:22.780765 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-caccf55b-1477-4d93-8050-ad82ab7acbd0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:22.781376 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-caccf55b-1477-4d93-8050-ad82ab7acbd0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:22.788204 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-caccf55b-1477-4d93-8050-ad82ab7acbd0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:22.788662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-caccf55b-1477-4d93-8050-ad82ab7acbd0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:22.789430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-caccf55b-1477-4d93-8050-ad82ab7acbd0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:22.789865 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-caccf55b-1477-4d93-8050-ad82ab7acbd0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:22.856667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-caccf55b-1477-4d93-8050-ad82ab7acbd0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:22.865226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-caccf55b-1477-4d93-8050-ad82ab7acbd0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088953 May 26 13:32:22.865812 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1049/2124] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:22 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:23.882433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77f9e3f7-f95a-4f29-a026-da8812b9c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:23.883146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77f9e3f7-f95a-4f29-a026-da8812b9c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:23.889561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77f9e3f7-f95a-4f29-a026-da8812b9c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:23.890010 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77f9e3f7-f95a-4f29-a026-da8812b9c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:23.890789 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77f9e3f7-f95a-4f29-a026-da8812b9c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:23.891243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77f9e3f7-f95a-4f29-a026-da8812b9c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:23.950908 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77f9e3f7-f95a-4f29-a026-da8812b9c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:23.958802 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77f9e3f7-f95a-4f29-a026-da8812b9c361 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080367 May 26 13:32:23.959365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1076/2125] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:23 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:24.976461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-778f358b-30f6-43e1-ad0b-961aa050931c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:24.977071 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-778f358b-30f6-43e1-ad0b-961aa050931c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:24.984032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778f358b-30f6-43e1-ad0b-961aa050931c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:24.984665 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778f358b-30f6-43e1-ad0b-961aa050931c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:24.986067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778f358b-30f6-43e1-ad0b-961aa050931c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:24.986507 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778f358b-30f6-43e1-ad0b-961aa050931c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:25.047789 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-778f358b-30f6-43e1-ad0b-961aa050931c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:25.055247 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-778f358b-30f6-43e1-ad0b-961aa050931c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082725 May 26 13:32:25.055811 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1050/2126] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:24 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:26.072058 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b810953-264b-4261-bc04-2ae24ba07b3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:26.072859 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b810953-264b-4261-bc04-2ae24ba07b3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:26.079344 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b810953-264b-4261-bc04-2ae24ba07b3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:26.079794 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b810953-264b-4261-bc04-2ae24ba07b3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:26.080547 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b810953-264b-4261-bc04-2ae24ba07b3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:26.080983 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b810953-264b-4261-bc04-2ae24ba07b3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:26.142165 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b810953-264b-4261-bc04-2ae24ba07b3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:26.149685 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b810953-264b-4261-bc04-2ae24ba07b3d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081490 May 26 13:32:26.150247 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1077/2127] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:26 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:27.166515 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7792b65e-c9ca-4350-a3a7-46265325c8ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:27.167150 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7792b65e-c9ca-4350-a3a7-46265325c8ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:27.173733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7792b65e-c9ca-4350-a3a7-46265325c8ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:27.174184 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7792b65e-c9ca-4350-a3a7-46265325c8ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:27.175011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7792b65e-c9ca-4350-a3a7-46265325c8ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:27.175451 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7792b65e-c9ca-4350-a3a7-46265325c8ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:27.236850 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7792b65e-c9ca-4350-a3a7-46265325c8ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:27.244239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7792b65e-c9ca-4350-a3a7-46265325c8ee tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081712 May 26 13:32:27.244806 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1051/2128] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:27 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:28.262609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be27a631-f00b-4f06-a76c-46095ac8b198 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:28.263390 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be27a631-f00b-4f06-a76c-46095ac8b198 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:28.270323 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be27a631-f00b-4f06-a76c-46095ac8b198 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:28.270812 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be27a631-f00b-4f06-a76c-46095ac8b198 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:28.271599 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be27a631-f00b-4f06-a76c-46095ac8b198 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:28.272030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be27a631-f00b-4f06-a76c-46095ac8b198 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:28.335316 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be27a631-f00b-4f06-a76c-46095ac8b198 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:28.342901 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be27a631-f00b-4f06-a76c-46095ac8b198 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085518 May 26 13:32:28.343471 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1078/2129] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:28 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:29.360076 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb2f35d0-17da-4c37-8301-6d109302a11a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:29.360702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb2f35d0-17da-4c37-8301-6d109302a11a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:29.367314 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb2f35d0-17da-4c37-8301-6d109302a11a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:29.367761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb2f35d0-17da-4c37-8301-6d109302a11a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:29.368540 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb2f35d0-17da-4c37-8301-6d109302a11a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:29.368986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb2f35d0-17da-4c37-8301-6d109302a11a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:29.433919 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb2f35d0-17da-4c37-8301-6d109302a11a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:29.443373 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb2f35d0-17da-4c37-8301-6d109302a11a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087118 May 26 13:32:29.444430 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1052/2130] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:29 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:30.461594 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4dc5fb9e-a3b9-4d8b-ac56-bdeab7fdd8a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:30.462216 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4dc5fb9e-a3b9-4d8b-ac56-bdeab7fdd8a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:30.469648 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4dc5fb9e-a3b9-4d8b-ac56-bdeab7fdd8a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:30.470106 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4dc5fb9e-a3b9-4d8b-ac56-bdeab7fdd8a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:30.470989 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4dc5fb9e-a3b9-4d8b-ac56-bdeab7fdd8a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:30.471436 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4dc5fb9e-a3b9-4d8b-ac56-bdeab7fdd8a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:30.537714 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4dc5fb9e-a3b9-4d8b-ac56-bdeab7fdd8a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:30.546444 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4dc5fb9e-a3b9-4d8b-ac56-bdeab7fdd8a1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088194 May 26 13:32:30.547158 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1079/2131] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:30 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:31.563588 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d885f2e3-bce9-4e73-81a2-1e379ec349da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:31.564102 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d885f2e3-bce9-4e73-81a2-1e379ec349da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:31.570577 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d885f2e3-bce9-4e73-81a2-1e379ec349da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:31.571028 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d885f2e3-bce9-4e73-81a2-1e379ec349da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:31.571788 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d885f2e3-bce9-4e73-81a2-1e379ec349da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:31.572226 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d885f2e3-bce9-4e73-81a2-1e379ec349da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:31.637091 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d885f2e3-bce9-4e73-81a2-1e379ec349da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:31.644674 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d885f2e3-bce9-4e73-81a2-1e379ec349da tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085371 May 26 13:32:31.645236 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1053/2132] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:31 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:32.661971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fb286929-254f-49e4-9865-0f4ceb4b7587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:32.662623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fb286929-254f-49e4-9865-0f4ceb4b7587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:32.673842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb286929-254f-49e4-9865-0f4ceb4b7587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:32.674691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb286929-254f-49e4-9865-0f4ceb4b7587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:32.675489 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb286929-254f-49e4-9865-0f4ceb4b7587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:32.675932 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb286929-254f-49e4-9865-0f4ceb4b7587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:32.738687 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb286929-254f-49e4-9865-0f4ceb4b7587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:32.746461 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fb286929-254f-49e4-9865-0f4ceb4b7587 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088408 May 26 13:32:32.747061 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1080/2133] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:32 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:33.763362 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5df3e166-5148-4779-9569-8bb3bc4d7242 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:33.764747 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5df3e166-5148-4779-9569-8bb3bc4d7242 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:33.776063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5df3e166-5148-4779-9569-8bb3bc4d7242 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:33.776511 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5df3e166-5148-4779-9569-8bb3bc4d7242 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:33.777287 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5df3e166-5148-4779-9569-8bb3bc4d7242 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:33.777724 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5df3e166-5148-4779-9569-8bb3bc4d7242 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:33.841760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5df3e166-5148-4779-9569-8bb3bc4d7242 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:33.849514 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5df3e166-5148-4779-9569-8bb3bc4d7242 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090011 May 26 13:32:33.850087 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1054/2134] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:33 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:34.866863 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c29aa8f2-aff7-4468-b969-e99f68f90210 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:34.867474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c29aa8f2-aff7-4468-b969-e99f68f90210 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:34.874147 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c29aa8f2-aff7-4468-b969-e99f68f90210 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:34.874623 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c29aa8f2-aff7-4468-b969-e99f68f90210 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:34.875409 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c29aa8f2-aff7-4468-b969-e99f68f90210 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:34.875817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c29aa8f2-aff7-4468-b969-e99f68f90210 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:34.936187 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c29aa8f2-aff7-4468-b969-e99f68f90210 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:34.943661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c29aa8f2-aff7-4468-b969-e99f68f90210 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080776 May 26 13:32:34.944230 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1081/2135] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:34 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:35.960708 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-725db9e4-67bf-454a-8adc-b273b4d4f751 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:35.961329 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-725db9e4-67bf-454a-8adc-b273b4d4f751 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:35.968039 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-725db9e4-67bf-454a-8adc-b273b4d4f751 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:35.968492 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-725db9e4-67bf-454a-8adc-b273b4d4f751 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:35.969271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-725db9e4-67bf-454a-8adc-b273b4d4f751 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:35.969712 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-725db9e4-67bf-454a-8adc-b273b4d4f751 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:36.030419 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-725db9e4-67bf-454a-8adc-b273b4d4f751 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:36.038067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-725db9e4-67bf-454a-8adc-b273b4d4f751 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081202 May 26 13:32:36.038656 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1055/2136] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:35 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:37.055127 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cbdd317-37ae-42a8-b165-953426c5dbfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:37.055737 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3cbdd317-37ae-42a8-b165-953426c5dbfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:37.062415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cbdd317-37ae-42a8-b165-953426c5dbfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:37.062896 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cbdd317-37ae-42a8-b165-953426c5dbfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:37.063652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cbdd317-37ae-42a8-b165-953426c5dbfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:37.064087 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cbdd317-37ae-42a8-b165-953426c5dbfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:37.125804 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3cbdd317-37ae-42a8-b165-953426c5dbfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:37.133586 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3cbdd317-37ae-42a8-b165-953426c5dbfd tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082270 May 26 13:32:37.137079 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1082/2137] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:37 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:38.040615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:32:38.041186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:32:38.151026 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c733b0cb-8515-4cbe-ab67-f3cdef5fa3d8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:38.151645 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c733b0cb-8515-4cbe-ab67-f3cdef5fa3d8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:38.158266 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c733b0cb-8515-4cbe-ab67-f3cdef5fa3d8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:38.158761 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c733b0cb-8515-4cbe-ab67-f3cdef5fa3d8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:38.159534 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c733b0cb-8515-4cbe-ab67-f3cdef5fa3d8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:38.159976 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c733b0cb-8515-4cbe-ab67-f3cdef5fa3d8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:38.226953 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c733b0cb-8515-4cbe-ab67-f3cdef5fa3d8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:38.235874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c733b0cb-8515-4cbe-ab67-f3cdef5fa3d8 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088615 May 26 13:32:38.236476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1056/2138] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:38 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:39.253148 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14274969-9e44-4f40-9091-3733640b9bf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:39.253773 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-14274969-9e44-4f40-9091-3733640b9bf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:39.256171 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:39.261108 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14274969-9e44-4f40-9091-3733640b9bf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:39.261559 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14274969-9e44-4f40-9091-3733640b9bf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:39.262349 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14274969-9e44-4f40-9091-3733640b9bf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:39.262846 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14274969-9e44-4f40-9091-3733640b9bf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:39.330718 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14274969-9e44-4f40-9091-3733640b9bf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:39.338288 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-14274969-9e44-4f40-9091-3733640b9bf9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089114 May 26 13:32:39.338966 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1083/2139] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:39 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:40.355684 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-51fd91cb-9b86-443e-93f5-92acd2771d68 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:40.356216 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-51fd91cb-9b86-443e-93f5-92acd2771d68 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:40.358601 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:40.363388 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51fd91cb-9b86-443e-93f5-92acd2771d68 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:40.363862 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51fd91cb-9b86-443e-93f5-92acd2771d68 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:40.364621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51fd91cb-9b86-443e-93f5-92acd2771d68 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:40.365055 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51fd91cb-9b86-443e-93f5-92acd2771d68 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:40.428857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-51fd91cb-9b86-443e-93f5-92acd2771d68 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:40.437291 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-51fd91cb-9b86-443e-93f5-92acd2771d68 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085739 May 26 13:32:40.437854 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1057/2140] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:40 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:41.454495 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fb345b67-e35a-4d38-a530-b0f941d9b742 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:41.455128 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fb345b67-e35a-4d38-a530-b0f941d9b742 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:41.461838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb345b67-e35a-4d38-a530-b0f941d9b742 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:41.462268 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb345b67-e35a-4d38-a530-b0f941d9b742 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:41.463069 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb345b67-e35a-4d38-a530-b0f941d9b742 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:41.463507 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb345b67-e35a-4d38-a530-b0f941d9b742 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:41.525270 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb345b67-e35a-4d38-a530-b0f941d9b742 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:41.534001 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fb345b67-e35a-4d38-a530-b0f941d9b742 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083787 May 26 13:32:41.534515 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1084/2141] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:41 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:42.554690 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f4f01bae-a0ba-4dc4-b4b2-b5e5c821fa64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:42.555229 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f4f01bae-a0ba-4dc4-b4b2-b5e5c821fa64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:42.563755 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4f01bae-a0ba-4dc4-b4b2-b5e5c821fa64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:42.564211 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4f01bae-a0ba-4dc4-b4b2-b5e5c821fa64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:42.564995 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4f01bae-a0ba-4dc4-b4b2-b5e5c821fa64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:42.565438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4f01bae-a0ba-4dc4-b4b2-b5e5c821fa64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:42.629024 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f4f01bae-a0ba-4dc4-b4b2-b5e5c821fa64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:42.636639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f4f01bae-a0ba-4dc4-b4b2-b5e5c821fa64 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087272 May 26 13:32:42.637240 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1058/2142] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:42 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:43.653658 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d447b9a0-5978-41b7-a13b-00f496272c37 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:43.654277 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d447b9a0-5978-41b7-a13b-00f496272c37 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:43.661227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d447b9a0-5978-41b7-a13b-00f496272c37 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:43.661679 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d447b9a0-5978-41b7-a13b-00f496272c37 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:43.662443 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d447b9a0-5978-41b7-a13b-00f496272c37 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:43.662918 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d447b9a0-5978-41b7-a13b-00f496272c37 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:43.665422 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:43.727363 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d447b9a0-5978-41b7-a13b-00f496272c37 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:43.736104 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d447b9a0-5978-41b7-a13b-00f496272c37 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.086260 May 26 13:32:43.736691 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1085/2143] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:43 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:44.752847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-524bb45e-666d-4290-a580-b222a82ad622 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:44.753639 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-524bb45e-666d-4290-a580-b222a82ad622 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:44.760209 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-524bb45e-666d-4290-a580-b222a82ad622 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:44.760668 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-524bb45e-666d-4290-a580-b222a82ad622 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:44.761443 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-524bb45e-666d-4290-a580-b222a82ad622 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:44.761887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-524bb45e-666d-4290-a580-b222a82ad622 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:44.764643 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:44.828289 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-524bb45e-666d-4290-a580-b222a82ad622 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:44.835977 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-524bb45e-666d-4290-a580-b222a82ad622 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087682 May 26 13:32:44.836553 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1059/2144] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:44 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:44.990441 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:32:44.990685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:32:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:32:45.853142 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17dbb7ef-1cce-47a9-be72-b8452f7338ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:45.861365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17dbb7ef-1cce-47a9-be72-b8452f7338ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:45.861365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17dbb7ef-1cce-47a9-be72-b8452f7338ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:45.861365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17dbb7ef-1cce-47a9-be72-b8452f7338ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:45.861931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17dbb7ef-1cce-47a9-be72-b8452f7338ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:45.862364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17dbb7ef-1cce-47a9-be72-b8452f7338ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:45.927278 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-17dbb7ef-1cce-47a9-be72-b8452f7338ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:45.934842 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17dbb7ef-1cce-47a9-be72-b8452f7338ce tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085563 May 26 13:32:45.935406 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1086/2145] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:45 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:46.952728 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e3f67d0-5586-41f5-8065-02eecd592f39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:46.953336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e3f67d0-5586-41f5-8065-02eecd592f39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:46.959944 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e3f67d0-5586-41f5-8065-02eecd592f39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:46.960397 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e3f67d0-5586-41f5-8065-02eecd592f39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:46.961155 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e3f67d0-5586-41f5-8065-02eecd592f39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:46.961587 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e3f67d0-5586-41f5-8065-02eecd592f39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:47.021963 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e3f67d0-5586-41f5-8065-02eecd592f39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:47.029542 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e3f67d0-5586-41f5-8065-02eecd592f39 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080606 May 26 13:32:47.030395 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1060/2146] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:46 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:48.047543 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77183e97-0049-4f29-b687-8b46df26a718 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:48.048086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77183e97-0049-4f29-b687-8b46df26a718 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:48.054767 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77183e97-0049-4f29-b687-8b46df26a718 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:48.055221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77183e97-0049-4f29-b687-8b46df26a718 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:48.055990 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77183e97-0049-4f29-b687-8b46df26a718 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:48.056433 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77183e97-0049-4f29-b687-8b46df26a718 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:48.124281 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77183e97-0049-4f29-b687-8b46df26a718 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:48.132080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77183e97-0049-4f29-b687-8b46df26a718 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089140 May 26 13:32:48.132659 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1087/2147] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:48 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:32:49.151339 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e0d2a62-d055-48b6-b7b6-73bb36af7372 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:49.152119 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e0d2a62-d055-48b6-b7b6-73bb36af7372 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:49.159623 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e0d2a62-d055-48b6-b7b6-73bb36af7372 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:49.160075 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e0d2a62-d055-48b6-b7b6-73bb36af7372 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:49.160898 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e0d2a62-d055-48b6-b7b6-73bb36af7372 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:49.161436 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e0d2a62-d055-48b6-b7b6-73bb36af7372 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:49.228396 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e0d2a62-d055-48b6-b7b6-73bb36af7372 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:49.237183 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e0d2a62-d055-48b6-b7b6-73bb36af7372 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.091265 May 26 13:32:49.237763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1061/2148] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:49 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:50.254018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-208717fb-8f65-4555-8a12-01f1a4fb339a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:50.254699 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-208717fb-8f65-4555-8a12-01f1a4fb339a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:50.261267 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-208717fb-8f65-4555-8a12-01f1a4fb339a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:50.261731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-208717fb-8f65-4555-8a12-01f1a4fb339a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:50.262512 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-208717fb-8f65-4555-8a12-01f1a4fb339a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:50.262979 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-208717fb-8f65-4555-8a12-01f1a4fb339a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:50.334292 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-208717fb-8f65-4555-8a12-01f1a4fb339a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:50.342403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-208717fb-8f65-4555-8a12-01f1a4fb339a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.091787 May 26 13:32:50.343348 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1088/2149] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:50 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:51.361299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-264e2541-a125-44e2-bb45-30d4be283067 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:51.361921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-264e2541-a125-44e2-bb45-30d4be283067 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:51.368159 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-264e2541-a125-44e2-bb45-30d4be283067 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:51.368612 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-264e2541-a125-44e2-bb45-30d4be283067 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:51.369389 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-264e2541-a125-44e2-bb45-30d4be283067 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:51.369833 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-264e2541-a125-44e2-bb45-30d4be283067 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:51.440196 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-264e2541-a125-44e2-bb45-30d4be283067 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:51.449333 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-264e2541-a125-44e2-bb45-30d4be283067 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.092420 May 26 13:32:51.450208 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1062/2150] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:51 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:52.466154 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-32aff7a1-61fb-44fd-a237-75a8eab4936d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:52.466796 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-32aff7a1-61fb-44fd-a237-75a8eab4936d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:52.473750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32aff7a1-61fb-44fd-a237-75a8eab4936d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:52.474207 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32aff7a1-61fb-44fd-a237-75a8eab4936d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:52.475008 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32aff7a1-61fb-44fd-a237-75a8eab4936d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:52.475456 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32aff7a1-61fb-44fd-a237-75a8eab4936d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:52.535656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-32aff7a1-61fb-44fd-a237-75a8eab4936d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:52.543280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-32aff7a1-61fb-44fd-a237-75a8eab4936d tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081049 May 26 13:32:52.543851 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1089/2151] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:52 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:53.560090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-85c6ada2-6815-4ef2-8506-254f49b59632 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:53.560627 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-85c6ada2-6815-4ef2-8506-254f49b59632 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:53.567972 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85c6ada2-6815-4ef2-8506-254f49b59632 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:53.568428 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85c6ada2-6815-4ef2-8506-254f49b59632 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:53.569221 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85c6ada2-6815-4ef2-8506-254f49b59632 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:53.569655 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85c6ada2-6815-4ef2-8506-254f49b59632 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:53.636847 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85c6ada2-6815-4ef2-8506-254f49b59632 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:53.645945 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-85c6ada2-6815-4ef2-8506-254f49b59632 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.089720 May 26 13:32:53.652495 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1063/2152] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:53 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:54.665988 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-47ff308a-5c54-46da-b893-5a56e89807e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:54.666614 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-47ff308a-5c54-46da-b893-5a56e89807e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:54.673636 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47ff308a-5c54-46da-b893-5a56e89807e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:54.674080 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47ff308a-5c54-46da-b893-5a56e89807e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:54.674856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47ff308a-5c54-46da-b893-5a56e89807e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:54.675290 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47ff308a-5c54-46da-b893-5a56e89807e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:54.735365 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-47ff308a-5c54-46da-b893-5a56e89807e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:54.742743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-47ff308a-5c54-46da-b893-5a56e89807e4 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.080913 May 26 13:32:54.743322 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1090/2153] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:54 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:55.760517 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d81c81d4-53d5-4a44-be16-3cda8fce09fb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:55.761126 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d81c81d4-53d5-4a44-be16-3cda8fce09fb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:55.768420 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d81c81d4-53d5-4a44-be16-3cda8fce09fb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:55.768868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d81c81d4-53d5-4a44-be16-3cda8fce09fb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:55.769632 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d81c81d4-53d5-4a44-be16-3cda8fce09fb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:55.770070 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d81c81d4-53d5-4a44-be16-3cda8fce09fb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:55.832506 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d81c81d4-53d5-4a44-be16-3cda8fce09fb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:55.840299 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d81c81d4-53d5-4a44-be16-3cda8fce09fb tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083588 May 26 13:32:55.840871 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1064/2154] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:55 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:56.857479 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2d633548-f777-46cc-80fa-9c71e7bac367 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:56.858083 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2d633548-f777-46cc-80fa-9c71e7bac367 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:56.865410 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d633548-f777-46cc-80fa-9c71e7bac367 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:56.865857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d633548-f777-46cc-80fa-9c71e7bac367 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:56.866666 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d633548-f777-46cc-80fa-9c71e7bac367 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:56.867105 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d633548-f777-46cc-80fa-9c71e7bac367 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:56.936675 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d633548-f777-46cc-80fa-9c71e7bac367 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:56.944284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2d633548-f777-46cc-80fa-9c71e7bac367 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090849 May 26 13:32:56.944869 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1091/2155] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:56 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:57.961551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1a0df7e-2fd1-41ae-86a1-78a49f62063a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:57.962165 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1a0df7e-2fd1-41ae-86a1-78a49f62063a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:57.968760 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1a0df7e-2fd1-41ae-86a1-78a49f62063a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:57.969877 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1a0df7e-2fd1-41ae-86a1-78a49f62063a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:57.970703 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1a0df7e-2fd1-41ae-86a1-78a49f62063a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:57.971148 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1a0df7e-2fd1-41ae-86a1-78a49f62063a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:58.043630 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1a0df7e-2fd1-41ae-86a1-78a49f62063a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:58.055346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1a0df7e-2fd1-41ae-86a1-78a49f62063a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.097366 May 26 13:32:58.056193 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1065/2156] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:57 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:32:59.073168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab218555-d1eb-48ca-965e-19ed2b7d4257 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:32:59.073777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab218555-d1eb-48ca-965e-19ed2b7d4257 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:32:59.080876 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab218555-d1eb-48ca-965e-19ed2b7d4257 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:59.081354 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab218555-d1eb-48ca-965e-19ed2b7d4257 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:59.082112 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab218555-d1eb-48ca-965e-19ed2b7d4257 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:32:59.082629 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab218555-d1eb-48ca-965e-19ed2b7d4257 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:32:59.143579 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab218555-d1eb-48ca-965e-19ed2b7d4257 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:32:59.151093 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab218555-d1eb-48ca-965e-19ed2b7d4257 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.081805 May 26 13:32:59.151666 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1092/2157] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:32:59 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:00.168093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-edc34308-3b82-4a60-bf50-fffeeeb6e56a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:00.168702 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-edc34308-3b82-4a60-bf50-fffeeeb6e56a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:00.175549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-edc34308-3b82-4a60-bf50-fffeeeb6e56a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:00.176000 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-edc34308-3b82-4a60-bf50-fffeeeb6e56a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:00.176843 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-edc34308-3b82-4a60-bf50-fffeeeb6e56a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:00.177279 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-edc34308-3b82-4a60-bf50-fffeeeb6e56a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:00.240835 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-edc34308-3b82-4a60-bf50-fffeeeb6e56a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:00.248346 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-edc34308-3b82-4a60-bf50-fffeeeb6e56a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084136 May 26 13:33:00.248946 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1066/2158] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:00 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:01.265227 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e3122096-b9b3-4037-9f54-5b2e499209a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:01.265834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e3122096-b9b3-4037-9f54-5b2e499209a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:01.272389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3122096-b9b3-4037-9f54-5b2e499209a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:01.272834 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3122096-b9b3-4037-9f54-5b2e499209a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:01.273588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3122096-b9b3-4037-9f54-5b2e499209a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:01.274024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3122096-b9b3-4037-9f54-5b2e499209a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:01.337364 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3122096-b9b3-4037-9f54-5b2e499209a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:01.344872 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e3122096-b9b3-4037-9f54-5b2e499209a2 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083507 May 26 13:33:01.345438 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1093/2159] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:01 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:02.362246 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3b5488c-8ab4-450b-8065-042099f1b1a7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:02.362990 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3b5488c-8ab4-450b-8065-042099f1b1a7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:02.370704 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3b5488c-8ab4-450b-8065-042099f1b1a7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:02.371158 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3b5488c-8ab4-450b-8065-042099f1b1a7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:02.371923 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3b5488c-8ab4-450b-8065-042099f1b1a7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:02.372355 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3b5488c-8ab4-450b-8065-042099f1b1a7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:02.436245 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3b5488c-8ab4-450b-8065-042099f1b1a7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:02.446649 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3b5488c-8ab4-450b-8065-042099f1b1a7 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.088299 May 26 13:33:02.447238 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1067/2160] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:02 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:03.457070 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:33:03.458196 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:33:03.464516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e121b36b-79eb-48f5-a98f-78ee156dbfd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:03.465650 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e121b36b-79eb-48f5-a98f-78ee156dbfd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:03.472478 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e121b36b-79eb-48f5-a98f-78ee156dbfd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:03.472931 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e121b36b-79eb-48f5-a98f-78ee156dbfd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:03.473821 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e121b36b-79eb-48f5-a98f-78ee156dbfd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:03.474263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e121b36b-79eb-48f5-a98f-78ee156dbfd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:03.540496 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e121b36b-79eb-48f5-a98f-78ee156dbfd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:03.552047 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e121b36b-79eb-48f5-a98f-78ee156dbfd1 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.091315 May 26 13:33:03.552740 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1094/2161] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:03 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:04.569487 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb42f11f-b0df-47e4-94e7-239cbc217ad5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:04.570074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb42f11f-b0df-47e4-94e7-239cbc217ad5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:04.576570 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb42f11f-b0df-47e4-94e7-239cbc217ad5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:04.577027 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb42f11f-b0df-47e4-94e7-239cbc217ad5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:04.577796 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb42f11f-b0df-47e4-94e7-239cbc217ad5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:04.578235 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb42f11f-b0df-47e4-94e7-239cbc217ad5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:04.639671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bb42f11f-b0df-47e4-94e7-239cbc217ad5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:04.647429 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb42f11f-b0df-47e4-94e7-239cbc217ad5 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082430 May 26 13:33:04.647994 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1068/2162] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:04 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:05.664619 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb5f893e-ba59-4661-b6b1-2bd797b76617 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:05.665229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb5f893e-ba59-4661-b6b1-2bd797b76617 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:05.672018 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb5f893e-ba59-4661-b6b1-2bd797b76617 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:05.672467 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb5f893e-ba59-4661-b6b1-2bd797b76617 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:05.673222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb5f893e-ba59-4661-b6b1-2bd797b76617 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:05.673661 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb5f893e-ba59-4661-b6b1-2bd797b76617 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:05.736696 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cb5f893e-ba59-4661-b6b1-2bd797b76617 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:05.745086 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb5f893e-ba59-4661-b6b1-2bd797b76617 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084840 May 26 13:33:05.745656 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1095/2163] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:05 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:06.761375 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-998e1ed5-3b5f-44f3-9480-03a772c8b9ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:06.762013 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-998e1ed5-3b5f-44f3-9480-03a772c8b9ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:06.768581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-998e1ed5-3b5f-44f3-9480-03a772c8b9ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:06.769035 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-998e1ed5-3b5f-44f3-9480-03a772c8b9ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:06.769792 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-998e1ed5-3b5f-44f3-9480-03a772c8b9ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:06.770838 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-998e1ed5-3b5f-44f3-9480-03a772c8b9ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:06.833987 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-998e1ed5-3b5f-44f3-9480-03a772c8b9ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:06.841504 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-998e1ed5-3b5f-44f3-9480-03a772c8b9ab tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083987 May 26 13:33:06.842109 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1069/2164] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:06 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:07.859632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-429906c7-1f6c-4ec4-ba0f-ba7f333020d9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:07.860234 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-429906c7-1f6c-4ec4-ba0f-ba7f333020d9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:07.867532 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-429906c7-1f6c-4ec4-ba0f-ba7f333020d9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:07.867978 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-429906c7-1f6c-4ec4-ba0f-ba7f333020d9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:07.868734 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-429906c7-1f6c-4ec4-ba0f-ba7f333020d9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:07.869168 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-429906c7-1f6c-4ec4-ba0f-ba7f333020d9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:08.183643 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-429906c7-1f6c-4ec4-ba0f-ba7f333020d9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:08.191243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-429906c7-1f6c-4ec4-ba0f-ba7f333020d9 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.335413 May 26 13:33:08.191816 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1096/2165] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:07 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:09.208414 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e30b2494-d8e3-4c85-bc16-2f3213f71f2a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:09.209033 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e30b2494-d8e3-4c85-bc16-2f3213f71f2a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:09.215637 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e30b2494-d8e3-4c85-bc16-2f3213f71f2a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:09.216095 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e30b2494-d8e3-4c85-bc16-2f3213f71f2a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:09.216868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e30b2494-d8e3-4c85-bc16-2f3213f71f2a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:09.217342 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e30b2494-d8e3-4c85-bc16-2f3213f71f2a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:09.279907 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e30b2494-d8e3-4c85-bc16-2f3213f71f2a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:09.288555 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e30b2494-d8e3-4c85-bc16-2f3213f71f2a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084236 May 26 13:33:09.289359 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1070/2166] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:09 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:10.306565 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f3702be-6ab3-486f-8f2e-74d5c1191538 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:10.307210 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f3702be-6ab3-486f-8f2e-74d5c1191538 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:10.309530 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:33:10.314263 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f3702be-6ab3-486f-8f2e-74d5c1191538 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:10.314760 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f3702be-6ab3-486f-8f2e-74d5c1191538 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:10.315514 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f3702be-6ab3-486f-8f2e-74d5c1191538 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:10.315962 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f3702be-6ab3-486f-8f2e-74d5c1191538 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:10.377064 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f3702be-6ab3-486f-8f2e-74d5c1191538 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:10.385403 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f3702be-6ab3-486f-8f2e-74d5c1191538 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083015 May 26 13:33:10.385983 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1097/2167] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:10 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:11.403349 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cabdd71c-a62a-4dc1-a26a-eddc8ec4651c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:11.403964 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cabdd71c-a62a-4dc1-a26a-eddc8ec4651c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:11.405858 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:33:11.410857 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cabdd71c-a62a-4dc1-a26a-eddc8ec4651c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:11.411493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cabdd71c-a62a-4dc1-a26a-eddc8ec4651c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:11.412282 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cabdd71c-a62a-4dc1-a26a-eddc8ec4651c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:11.412733 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cabdd71c-a62a-4dc1-a26a-eddc8ec4651c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:11.475145 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cabdd71c-a62a-4dc1-a26a-eddc8ec4651c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:11.482886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cabdd71c-a62a-4dc1-a26a-eddc8ec4651c tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.084115 May 26 13:33:11.483449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1071/2168] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:11 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:12.500609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9162dfd-13cd-436e-8d4c-4512892ae27f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:12.501130 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9162dfd-13cd-436e-8d4c-4512892ae27f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:12.508123 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9162dfd-13cd-436e-8d4c-4512892ae27f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:12.508577 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9162dfd-13cd-436e-8d4c-4512892ae27f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:12.509368 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9162dfd-13cd-436e-8d4c-4512892ae27f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:12.509813 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9162dfd-13cd-436e-8d4c-4512892ae27f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:12.572389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9162dfd-13cd-436e-8d4c-4512892ae27f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:12.579886 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9162dfd-13cd-436e-8d4c-4512892ae27f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.083253 May 26 13:33:12.580453 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1098/2169] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:12 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:13.298501 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:33:13.298954 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:33:13.596662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d5d2e71-224c-4df2-9844-e3088242e237 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:13.597201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d5d2e71-224c-4df2-9844-e3088242e237 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:13.605271 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d5d2e71-224c-4df2-9844-e3088242e237 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:13.605722 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d5d2e71-224c-4df2-9844-e3088242e237 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:13.606489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d5d2e71-224c-4df2-9844-e3088242e237 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:13.606957 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d5d2e71-224c-4df2-9844-e3088242e237 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:13.672090 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d5d2e71-224c-4df2-9844-e3088242e237 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:13.680120 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d5d2e71-224c-4df2-9844-e3088242e237 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087395 May 26 13:33:13.680681 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1072/2170] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:13 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:14.697440 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd2e58c5-761b-4c4f-9a35-76becdb08f7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:14.698076 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fd2e58c5-761b-4c4f-9a35-76becdb08f7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:14.704617 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd2e58c5-761b-4c4f-9a35-76becdb08f7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:14.705060 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd2e58c5-761b-4c4f-9a35-76becdb08f7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:14.705815 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd2e58c5-761b-4c4f-9a35-76becdb08f7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:14.706254 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd2e58c5-761b-4c4f-9a35-76becdb08f7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:14.710280 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=84 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:33:14.775732 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fd2e58c5-761b-4c4f-9a35-76becdb08f7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:14.783633 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd2e58c5-761b-4c4f-9a35-76becdb08f7f tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.090198 May 26 13:33:14.784201 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1099/2171] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:14 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:15.800078 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-daa33517-4b85-41a3-af08-72260987265a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:15.800685 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-daa33517-4b85-41a3-af08-72260987265a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:15.807340 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-daa33517-4b85-41a3-af08-72260987265a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:15.807790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-daa33517-4b85-41a3-af08-72260987265a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:15.808546 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-daa33517-4b85-41a3-af08-72260987265a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:15.808986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-daa33517-4b85-41a3-af08-72260987265a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:15.812914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:33:15.875564 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-daa33517-4b85-41a3-af08-72260987265a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:15.883292 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-daa33517-4b85-41a3-af08-72260987265a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.087087 May 26 13:33:15.883855 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1073/2172] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:15 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:16.902867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bbe032cf-aa9b-498d-9233-7d5ad9b13fe0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:16.903483 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bbe032cf-aa9b-498d-9233-7d5ad9b13fe0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:16.910329 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbe032cf-aa9b-498d-9233-7d5ad9b13fe0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:16.910800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbe032cf-aa9b-498d-9233-7d5ad9b13fe0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:16.911562 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbe032cf-aa9b-498d-9233-7d5ad9b13fe0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:16.911998 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbe032cf-aa9b-498d-9233-7d5ad9b13fe0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:16.976396 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bbe032cf-aa9b-498d-9233-7d5ad9b13fe0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:16.984452 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bbe032cf-aa9b-498d-9233-7d5ad9b13fe0 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.085552 May 26 13:33:16.985014 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1100/2173] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:16 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:18.001341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-873c423a-ca01-42a7-bff7-2fc36664ffca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:18.001849 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-873c423a-ca01-42a7-bff7-2fc36664ffca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 82d4069d-fe62-4f1e-b4ad-ed907dbf2b99] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:18.008658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-873c423a-ca01-42a7-bff7-2fc36664ffca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:18.009108 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-873c423a-ca01-42a7-bff7-2fc36664ffca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:18.009875 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-873c423a-ca01-42a7-bff7-2fc36664ffca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:18.010317 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-873c423a-ca01-42a7-bff7-2fc36664ffca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:18.071917 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-873c423a-ca01-42a7-bff7-2fc36664ffca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491ef95e936943d5a144876c2fe22eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbaabf20652434cb79e0652ec678fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:33:18.079457 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-873c423a-ca01-42a7-bff7-2fc36664ffca tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99" status: 200 len: 1224 microversion: 2.1 time: 0.082145 May 26 13:33:18.080023 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1074/2174] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:17 2022] GET /compute/v2.1/servers/82d4069d-fe62-4f1e-b4ad-ed907dbf2b99 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:33:18.631984 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:18.632474 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:18.639114 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:18.639857 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:18.640343 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:18.640788 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:18.654536 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] HTTP exception thrown: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Request method failure captured: May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 HTTP/1.1 May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3oESiUfmslR-aYErDpKWpE09Ef8nhu8FvRKtodSjsoPVTBpZ9Hoo7lD5Q8btUXBQgvrBMf1fXC9hxYBT-mt2d5yat6w7PYE_7U36wW5HGMDTXB4Ih3ZUGpdspGdXteSAoeyjSzJ81AkSlMz_BmYtgrd5GOBm3Cv8dkpK8ie84b6T80 May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 2bbaabf20652434cb79e0652ec678fbb May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestVolumeBootPattern-416956949 May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 13:33:18.656243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestVolumeBootPattern-416956949 May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 2bbaabf20652434cb79e0652ec678fbb May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestVolumeBootPattern-416956949 May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-TestVolumeBootPattern-416956949-project May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: 491ef95e936943d5a144876c2fe22eaf May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestVolumeBootPattern-416956949-project May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.657389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '695090ba-e147-4dee-b9e6-2a6050b3b776'} May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:33:18.658030 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.659199 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:33:18.660516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Returning 404 to user: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:33:18.660516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-73861fb2-778c-451f-8942-a638c7f70545 tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "DELETE /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 404 len: 111 microversion: 2.1 time: 0.030289 May 26 13:33:18.660516 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1101/2175] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:33:18 2022] DELETE /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:33:18.666402 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:33:18.667152 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] [instance: 695090ba-e147-4dee-b9e6-2a6050b3b776] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:33:18.684423 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:18.684881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:18.685663 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:33:18.686111 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:33:18.699827 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] HTTP exception thrown: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Request method failure captured: May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 HTTP/1.1 May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept: application/json May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Connection: close May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Host: 10.222.0.60 May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABij3oESiUfmslR-aYErDpKWpE09Ef8nhu8FvRKtodSjsoPVTBpZ9Hoo7lD5Q8btUXBQgvrBMf1fXC9hxYBT-mt2d5yat6w7PYE_7U36wW5HGMDTXB4Ih3ZUGpdspGdXteSAoeyjSzJ81AkSlMz_BmYtgrd5GOBm3Cv8dkpK8ie84b6T80 May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Id: 2bbaabf20652434cb79e0652ec678fbb May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestVolumeBootPattern-416956949 May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Role: reader,member May 26 13:33:18.701589 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Roles: reader,member May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2bbaabf20652434cb79e0652ec678fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestVolumeBootPattern-416956949 May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 2bbaabf20652434cb79e0652ec678fbb May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestVolumeBootPattern-416956949 May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User: tempest-TestVolumeBootPattern-416956949-project May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Id: 491ef95e936943d5a144876c2fe22eaf May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestVolumeBootPattern-416956949-project May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: method: > May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: exception: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.702776 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: action_args: {'id': '695090ba-e147-4dee-b9e6-2a6050b3b776'} May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:33:18.703548 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. May 26 13:33:18.704654 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 26 13:33:18.705714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Returning 404 to user: Instance 695090ba-e147-4dee-b9e6-2a6050b3b776 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:33:18.705714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fec422d6-0288-4e3d-9c34-0791c28b818a tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776" status: 404 len: 111 microversion: 2.1 time: 0.040472 May 26 13:33:18.705714 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1075/2176] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:33:18 2022] GET /compute/v2.1/servers/695090ba-e147-4dee-b9e6-2a6050b3b776 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:34:25.846337 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:34:25.846975 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:34:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:35:13.410652 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:35:13.411332 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:35:58.049139 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:35:58.049723 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:35:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:36:04.998182 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:36:04.998876 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:36:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:36:23.471050 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:36:23.471694 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:36:33.307432 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:36:33.307921 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:36:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:37:45.854774 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:37:45.855588 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:38:33.419750 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:38:33.420442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:39:18.058726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:39:18.059341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:39:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:39:20.499897 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b3b9eca4-4f20-401c-bcf6-4a434357ddcc] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 13:39:20.500689 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=9 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:20.503850 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=13 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:20.506489 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c50e246-6d7b-4477-9abd-a74befd663de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] Calling method '.version_select at 0x7f49903bae50>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:39:20.618899 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c50e246-6d7b-4477-9abd-a74befd663de tempest-TestVolumeBootPattern-416956949 tempest-TestVolumeBootPattern-416956949-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-193225139" status: 202 len: 0 microversion: 2.1 time: 0.120783 May 26 13:39:20.619534 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1102/2177] 10.222.0.60 () {58 vars in 1259 bytes} [Thu May 26 13:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-193225139 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:39:25.005887 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:39:25.006367 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:39:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:39:43.479442 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:39:43.479971 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:39:53.315715 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:39:53.316300 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:39:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:40:27.192615 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13d1f0c7-cdff-4727-920c-751392da3fd3] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 13:40:27.193336 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=9 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.193894 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=13 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.197848 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-554634063", "imageRef": "85cb2fe0-73b9-4f67-9b48-430365fa6ef8", "flavorRef": "452", "networks": [{"uuid": "10424dea-7880-4b1e-aef2-54a28db4012f"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:40:27.528874 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] validate_networks() for [('10424dea-7880-4b1e-aef2-54a28db4012f', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:40:27.985651 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:40:27.986074 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:40:27.986569 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:40:27.986982 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:40:27.987391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:40:27.996638 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:27.997094 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:27.997886 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:27.998320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:28.018073 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Getting quotas for project 9b22744f23304e41b1c3a5d2bc0afdb9. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:40:28.021942 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Getting quotas for user d9fc5cfd0a50441c9fd9116a7b5c514a and project 9b22744f23304e41b1c3a5d2bc0afdb9. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:40:28.033214 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:40:28.035482 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85cb2fe0-73b9-4f67-9b48-430365fa6ef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:40:28.200621 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] [13d1f0c7-cdff-4727-920c-751392da3fd3] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 58918. May 26 13:40:28.235734 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a0cc984d-0a97-4359-8d40-2d119e79e5bb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045071 May 26 13:40:28.236590 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1076/2178] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 26 13:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:40:28.245466 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:28.259226 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6237c719-2a70-4e2b-9d56-433899982fbb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:28.259509 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6237c719-2a70-4e2b-9d56-433899982fbb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:28.262402 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] [b3b9eca4-4f20-401c-bcf6-4a434357ddcc] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 58924. May 26 13:40:28.424561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6237c719-2a70-4e2b-9d56-433899982fbb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:28.431229 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6237c719-2a70-4e2b-9d56-433899982fbb tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1218 microversion: 2.1 time: 0.187985 May 26 13:40:28.431817 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1103/2179] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:28 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:29.449997 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ed12d405-4229-4e86-9909-ec7d8238aa5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:29.450709 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ed12d405-4229-4e86-9909-ec7d8238aa5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:29.458163 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed12d405-4229-4e86-9909-ec7d8238aa5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:29.458662 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed12d405-4229-4e86-9909-ec7d8238aa5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:29.459447 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed12d405-4229-4e86-9909-ec7d8238aa5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:29.459897 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed12d405-4229-4e86-9909-ec7d8238aa5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:29.538602 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ed12d405-4229-4e86-9909-ec7d8238aa5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:29.547584 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ed12d405-4229-4e86-9909-ec7d8238aa5b tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1222 microversion: 2.1 time: 0.101968 May 26 13:40:29.548153 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1077/2180] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:29 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:30.564640 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c80a89e7-2212-458b-b8ab-1679c5df7b68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:30.565710 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c80a89e7-2212-458b-b8ab-1679c5df7b68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:30.574213 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80a89e7-2212-458b-b8ab-1679c5df7b68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:30.574711 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80a89e7-2212-458b-b8ab-1679c5df7b68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:30.575568 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80a89e7-2212-458b-b8ab-1679c5df7b68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:30.576019 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80a89e7-2212-458b-b8ab-1679c5df7b68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:30.673379 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c80a89e7-2212-458b-b8ab-1679c5df7b68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:30.680820 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c80a89e7-2212-458b-b8ab-1679c5df7b68 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1278 microversion: 2.1 time: 0.120725 May 26 13:40:30.689500 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1104/2181] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:30 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1278 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:31.697600 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4383a114-0491-47be-8d39-ed2abd3fbd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:31.698220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4383a114-0491-47be-8d39-ed2abd3fbd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:31.706093 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4383a114-0491-47be-8d39-ed2abd3fbd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:31.709391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4383a114-0491-47be-8d39-ed2abd3fbd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:31.709391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4383a114-0491-47be-8d39-ed2abd3fbd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:31.709391 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4383a114-0491-47be-8d39-ed2abd3fbd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:31.848167 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4383a114-0491-47be-8d39-ed2abd3fbd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:31.855671 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4383a114-0491-47be-8d39-ed2abd3fbd36 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.161934 May 26 13:40:31.856493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1078/2182] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:31 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:32.393425 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-dfb90947-ef80-4462-9b65-724b4f4a0d71 req-297595a1-b9d1-4781-8b18-020ace84cb91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9905f0da-0fe9-415a-8256-95cda343c11c", "tag": "e562e830-08e7-4fd8-bdb9-f6cd39d3f1a3"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:40:32.401686 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-dfb90947-ef80-4462-9b65-724b4f4a0d71 req-297595a1-b9d1-4781-8b18-020ace84cb91 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:32.402146 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-dfb90947-ef80-4462-9b65-724b4f4a0d71 req-297595a1-b9d1-4781-8b18-020ace84cb91 service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:32.414553 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-dfb90947-ef80-4462-9b65-724b4f4a0d71 req-297595a1-b9d1-4781-8b18-020ace84cb91 service nova] Creating event network-changed:e562e830-08e7-4fd8-bdb9-f6cd39d3f1a3 for instance 9905f0da-0fe9-415a-8256-95cda343c11c on hv-cinder-81514 May 26 13:40:32.421807 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-dfb90947-ef80-4462-9b65-724b4f4a0d71 req-297595a1-b9d1-4781-8b18-020ace84cb91 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105510 May 26 13:40:32.422024 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1105/2183] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:40:32.873610 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16428c35-d92d-49c2-8624-35937f080168 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:32.874889 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16428c35-d92d-49c2-8624-35937f080168 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:32.882063 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16428c35-d92d-49c2-8624-35937f080168 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:32.882520 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16428c35-d92d-49c2-8624-35937f080168 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:32.883320 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16428c35-d92d-49c2-8624-35937f080168 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:32.883762 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16428c35-d92d-49c2-8624-35937f080168 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:33.021341 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16428c35-d92d-49c2-8624-35937f080168 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:33.028904 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16428c35-d92d-49c2-8624-35937f080168 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.159545 May 26 13:40:33.029463 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1079/2184] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:32 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:40:34.047473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0cda6cde-c1e4-4d43-957e-a81102798411 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:34.048703 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0cda6cde-c1e4-4d43-957e-a81102798411 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:34.056621 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0cda6cde-c1e4-4d43-957e-a81102798411 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:34.057419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0cda6cde-c1e4-4d43-957e-a81102798411 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:34.058878 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0cda6cde-c1e4-4d43-957e-a81102798411 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:34.059706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0cda6cde-c1e4-4d43-957e-a81102798411 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:34.193877 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0cda6cde-c1e4-4d43-957e-a81102798411 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:34.201222 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0cda6cde-c1e4-4d43-957e-a81102798411 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.158967 May 26 13:40:34.201777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1106/2185] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:34 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:35.219852 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-18d77631-17e3-4fca-a1dc-98494d42b6c7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:35.220476 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-18d77631-17e3-4fca-a1dc-98494d42b6c7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:35.227001 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18d77631-17e3-4fca-a1dc-98494d42b6c7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:35.227449 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18d77631-17e3-4fca-a1dc-98494d42b6c7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:35.228225 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18d77631-17e3-4fca-a1dc-98494d42b6c7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:35.228658 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18d77631-17e3-4fca-a1dc-98494d42b6c7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:35.385400 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-18d77631-17e3-4fca-a1dc-98494d42b6c7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:35.393697 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-18d77631-17e3-4fca-a1dc-98494d42b6c7 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.178361 May 26 13:40:35.394290 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1080/2186] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:35 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:36.410858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b70db57-bfb0-448b-a36b-f01ccae334b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:36.411473 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b70db57-bfb0-448b-a36b-f01ccae334b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:36.418077 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b70db57-bfb0-448b-a36b-f01ccae334b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:36.418566 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b70db57-bfb0-448b-a36b-f01ccae334b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:36.419311 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b70db57-bfb0-448b-a36b-f01ccae334b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:36.419745 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b70db57-bfb0-448b-a36b-f01ccae334b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:36.550808 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7b70db57-bfb0-448b-a36b-f01ccae334b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:36.558448 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7b70db57-bfb0-448b-a36b-f01ccae334b8 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.151379 May 26 13:40:36.559031 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1107/2187] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:36 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:40:37.576064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0461896c-f6e9-40ed-8c46-f587e877a493 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:37.576679 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0461896c-f6e9-40ed-8c46-f587e877a493 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:37.584086 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0461896c-f6e9-40ed-8c46-f587e877a493 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:37.584549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0461896c-f6e9-40ed-8c46-f587e877a493 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:37.585332 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0461896c-f6e9-40ed-8c46-f587e877a493 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:37.585768 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0461896c-f6e9-40ed-8c46-f587e877a493 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:37.733277 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0461896c-f6e9-40ed-8c46-f587e877a493 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:37.748422 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0461896c-f6e9-40ed-8c46-f587e877a493 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.176192 May 26 13:40:37.749011 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1081/2188] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:37 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:38.771136 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-febf87dc-80f3-4d37-8890-68db044d73af tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:38.772209 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-febf87dc-80f3-4d37-8890-68db044d73af tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:38.776369 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:38.785021 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-febf87dc-80f3-4d37-8890-68db044d73af tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:38.785768 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-febf87dc-80f3-4d37-8890-68db044d73af tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:38.786949 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-febf87dc-80f3-4d37-8890-68db044d73af tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:38.787731 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-febf87dc-80f3-4d37-8890-68db044d73af tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:38.935204 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-febf87dc-80f3-4d37-8890-68db044d73af tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:38.943777 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-febf87dc-80f3-4d37-8890-68db044d73af tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.180004 May 26 13:40:38.944357 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1108/2189] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:38 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:39.457241 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:39.458248 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:39.531763 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-6789e148-e0d3-4be0-a182-aa3ab6f318e9 req-b2d3917c-5843-4d72-8862-22e91c82b02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9905f0da-0fe9-415a-8256-95cda343c11c", "name": "network-vif-plugged", "status": "completed", "tag": "e562e830-08e7-4fd8-bdb9-f6cd39d3f1a3"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:40:39.545738 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-6789e148-e0d3-4be0-a182-aa3ab6f318e9 req-b2d3917c-5843-4d72-8862-22e91c82b02a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:39.547454 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-6789e148-e0d3-4be0-a182-aa3ab6f318e9 req-b2d3917c-5843-4d72-8862-22e91c82b02a service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:39.568162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-6789e148-e0d3-4be0-a182-aa3ab6f318e9 req-b2d3917c-5843-4d72-8862-22e91c82b02a service nova] Creating event network-vif-plugged:e562e830-08e7-4fd8-bdb9-f6cd39d3f1a3 for instance 9905f0da-0fe9-415a-8256-95cda343c11c on hv-cinder-81514 May 26 13:40:39.577249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-6789e148-e0d3-4be0-a182-aa3ab6f318e9 req-b2d3917c-5843-4d72-8862-22e91c82b02a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127456 May 26 13:40:39.578059 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1082/2190] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:40:39.961858 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6aa35c9a-96c9-4531-ab2c-ceda9a004436 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:39.962571 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6aa35c9a-96c9-4531-ab2c-ceda9a004436 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:39.970735 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6aa35c9a-96c9-4531-ab2c-ceda9a004436 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:39.971176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6aa35c9a-96c9-4531-ab2c-ceda9a004436 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:39.971950 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6aa35c9a-96c9-4531-ab2c-ceda9a004436 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:39.972385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6aa35c9a-96c9-4531-ab2c-ceda9a004436 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:40.108176 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6aa35c9a-96c9-4531-ab2c-ceda9a004436 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:40.116838 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6aa35c9a-96c9-4531-ab2c-ceda9a004436 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.158878 May 26 13:40:40.117415 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1109/2191] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:39 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:41.134316 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b2a15c2e-0fe8-46e1-8626-32126f2be25a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:41.135032 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b2a15c2e-0fe8-46e1-8626-32126f2be25a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:41.142186 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2a15c2e-0fe8-46e1-8626-32126f2be25a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:41.142661 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2a15c2e-0fe8-46e1-8626-32126f2be25a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:41.143426 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2a15c2e-0fe8-46e1-8626-32126f2be25a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:41.143859 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b2a15c2e-0fe8-46e1-8626-32126f2be25a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:41.283060 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b2a15c2e-0fe8-46e1-8626-32126f2be25a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:41.290563 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b2a15c2e-0fe8-46e1-8626-32126f2be25a tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1318 microversion: 2.1 time: 0.160901 May 26 13:40:41.291138 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1083/2192] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:41 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:42.307385 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e897f913-898f-44c7-8c5c-e82cd4dd1091 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:40:42.307996 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e897f913-898f-44c7-8c5c-e82cd4dd1091 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:42.315221 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e897f913-898f-44c7-8c5c-e82cd4dd1091 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:42.315670 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e897f913-898f-44c7-8c5c-e82cd4dd1091 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:42.316445 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e897f913-898f-44c7-8c5c-e82cd4dd1091 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:42.316884 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e897f913-898f-44c7-8c5c-e82cd4dd1091 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:42.462606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e897f913-898f-44c7-8c5c-e82cd4dd1091 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:40:42.478511 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e897f913-898f-44c7-8c5c-e82cd4dd1091 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1507 microversion: 2.1 time: 0.174659 May 26 13:40:42.479609 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1110/2193] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:40:42 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:40:42.504868 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e5c13ea8-5369-426a-a80a-39311f7662ce tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53ac367b-0137-4c96-894e-76fd6e5cb1be", "device": "/dev/sdb"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:40:42.506790 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e5c13ea8-5369-426a-a80a-39311f7662ce tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:40:42.514986 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5c13ea8-5369-426a-a80a-39311f7662ce tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:42.515438 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5c13ea8-5369-426a-a80a-39311f7662ce tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:42.516224 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5c13ea8-5369-426a-a80a-39311f7662ce tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:40:42.516667 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5c13ea8-5369-426a-a80a-39311f7662ce tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:40:43.273860 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e5c13ea8-5369-426a-a80a-39311f7662ce tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "POST /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774986 May 26 13:40:43.274489 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1084/2194] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 26 13:40:42 2022] POST /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:41:05.863427 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:41:05.863982 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:41:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:41:06.399561 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-692264a7-7c82-477d-9eb0-4028e418acc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:41:06.400066 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-692264a7-7c82-477d-9eb0-4028e418acc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:41:06.402413 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=18 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:06.403301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=38 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:06.408153 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-692264a7-7c82-477d-9eb0-4028e418acc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:06.408611 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-692264a7-7c82-477d-9eb0-4028e418acc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:06.409389 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-692264a7-7c82-477d-9eb0-4028e418acc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:06.409856 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-692264a7-7c82-477d-9eb0-4028e418acc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:06.498672 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-692264a7-7c82-477d-9eb0-4028e418acc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lazy-loading 'services' on Instance uuid 9905f0da-0fe9-415a-8256-95cda343c11c {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:41:06.728284 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-692264a7-7c82-477d-9eb0-4028e418acc4 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c/os-volume_attachments/53ac367b-0137-4c96-894e-76fd6e5cb1be" status: 202 len: 0 microversion: 2.1 time: 0.332612 May 26 13:41:06.729706 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1111/2195] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 26 13:41:06 2022] DELETE /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c/os-volume_attachments/53ac367b-0137-4c96-894e-76fd6e5cb1be => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:41:07.845689 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-439effe6-917d-4a10-8214-c754202d9c52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:41:07.846493 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-439effe6-917d-4a10-8214-c754202d9c52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:41:07.848939 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:07.849620 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:07.856017 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-439effe6-917d-4a10-8214-c754202d9c52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:07.857640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-439effe6-917d-4a10-8214-c754202d9c52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:07.857640 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-439effe6-917d-4a10-8214-c754202d9c52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:07.857882 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-439effe6-917d-4a10-8214-c754202d9c52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:07.884475 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-439effe6-917d-4a10-8214-c754202d9c52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:41:08.263933 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-439effe6-917d-4a10-8214-c754202d9c52 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 204 len: 0 microversion: 2.1 time: 0.422123 May 26 13:41:08.264551 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1085/2196] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 26 13:41:07 2022] DELETE /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:41:08.273719 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-832a405c-dcd3-495b-8796-8948517fa8b6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:41:08.275243 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-832a405c-dcd3-495b-8796-8948517fa8b6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:41:08.285458 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-832a405c-dcd3-495b-8796-8948517fa8b6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:08.285934 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-832a405c-dcd3-495b-8796-8948517fa8b6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:08.286743 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-832a405c-dcd3-495b-8796-8948517fa8b6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:08.287180 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-832a405c-dcd3-495b-8796-8948517fa8b6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:08.419513 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-832a405c-dcd3-495b-8796-8948517fa8b6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:41:08.427205 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-832a405c-dcd3-495b-8796-8948517fa8b6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1513 microversion: 2.1 time: 0.158245 May 26 13:41:08.427782 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1112/2197] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:41:08 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:41:09.446353 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-194eb941-8a73-47bf-874d-556f5a34a1f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:41:09.447726 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-194eb941-8a73-47bf-874d-556f5a34a1f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:41:09.454345 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-194eb941-8a73-47bf-874d-556f5a34a1f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:09.454820 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-194eb941-8a73-47bf-874d-556f5a34a1f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:09.455581 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-194eb941-8a73-47bf-874d-556f5a34a1f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:09.456016 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-194eb941-8a73-47bf-874d-556f5a34a1f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:09.756220 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-194eb941-8a73-47bf-874d-556f5a34a1f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:41:09.764575 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-194eb941-8a73-47bf-874d-556f5a34a1f6 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1513 microversion: 2.1 time: 0.322469 May 26 13:41:09.765134 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1086/2198] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:41:09 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:41:10.782285 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b80eeb1c-3ab1-432c-a93c-59296d753fd2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:41:10.782942 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b80eeb1c-3ab1-432c-a93c-59296d753fd2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:41:10.789394 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b80eeb1c-3ab1-432c-a93c-59296d753fd2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:10.789867 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b80eeb1c-3ab1-432c-a93c-59296d753fd2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:10.790778 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b80eeb1c-3ab1-432c-a93c-59296d753fd2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:10.791217 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b80eeb1c-3ab1-432c-a93c-59296d753fd2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:10.920421 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b80eeb1c-3ab1-432c-a93c-59296d753fd2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:41:10.927864 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b80eeb1c-3ab1-432c-a93c-59296d753fd2 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1513 microversion: 2.1 time: 0.149457 May 26 13:41:10.928432 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1113/2199] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:41:10 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:41:11.945425 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6743f34-723d-4057-9e92-9e06b7243dea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:41:11.946067 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6743f34-723d-4057-9e92-9e06b7243dea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:41:11.953249 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6743f34-723d-4057-9e92-9e06b7243dea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:11.953696 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6743f34-723d-4057-9e92-9e06b7243dea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:11.954453 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6743f34-723d-4057-9e92-9e06b7243dea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:11.954914 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6743f34-723d-4057-9e92-9e06b7243dea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:12.089162 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6743f34-723d-4057-9e92-9e06b7243dea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:41:12.097064 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6743f34-723d-4057-9e92-9e06b7243dea tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1513 microversion: 2.1 time: 0.155722 May 26 13:41:12.097644 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1087/2200] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:41:11 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:41:12.593253 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-94658c43-eac7-42a7-81df-9b90e853c9a1 req-0e3ae78e-81db-49ff-b71c-79d6c6a6be6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9905f0da-0fe9-415a-8256-95cda343c11c", "name": "network-vif-deleted", "tag": "e562e830-08e7-4fd8-bdb9-f6cd39d3f1a3"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:41:12.601281 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-94658c43-eac7-42a7-81df-9b90e853c9a1 req-0e3ae78e-81db-49ff-b71c-79d6c6a6be6d service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:12.601729 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-94658c43-eac7-42a7-81df-9b90e853c9a1 req-0e3ae78e-81db-49ff-b71c-79d6c6a6be6d service nova] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:12.613685 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-94658c43-eac7-42a7-81df-9b90e853c9a1 req-0e3ae78e-81db-49ff-b71c-79d6c6a6be6d service nova] Creating event network-vif-deleted:e562e830-08e7-4fd8-bdb9-f6cd39d3f1a3 for instance 9905f0da-0fe9-415a-8256-95cda343c11c on hv-cinder-81514 May 26 13:41:12.619606 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-94658c43-eac7-42a7-81df-9b90e853c9a1 req-0e3ae78e-81db-49ff-b71c-79d6c6a6be6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 May 26 13:41:12.620301 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1114/2201] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 26 13:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:41:13.115168 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:41:13.115692 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:41:13.122781 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:13.123239 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:13.124008 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:13.124448 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:13.156791 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:13.157242 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:13.157691 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lazy-loading 'fault' on Instance uuid 9905f0da-0fe9-415a-8256-95cda343c11c {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:41:13.201201 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9fc5cfd0a50441c9fd9116a7b5c514a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b22744f23304e41b1c3a5d2bc0afdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:41:13.208616 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5cfc6181-efa8-41cd-b6d9-17ff2ffacb14 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 200 len: 1308 microversion: 2.1 time: 0.097395 May 26 13:41:13.209171 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1088/2202] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:41:13 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:41:14.229419 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:41:14.230160 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] [instance: 9905f0da-0fe9-415a-8256-95cda343c11c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:41:14.236399 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:14.236852 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:14.237607 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:41:14.238054 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Lock "9e72b17b-274a-4fb6-89bb-8004b3c5f49b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:41:14.251637 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] HTTP exception thrown: Instance 9905f0da-0fe9-415a-8256-95cda343c11c could not be found. May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Request method failure captured: May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c HTTP/1.1 May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept: application/json May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Connection: close May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Host: 10.222.0.60 May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABij3vCy1H-51q4mgFHK9T837zyr08jsfeCD28cNnfJdSCkASV9RAtXKJJ6zxdrYlaCPQPryOMk7NRcCORkajIIXh9w2ULQD3Kg6-EqkiXq9f3xA0gc0nk569h6TnrcsOee2KkOonC84p7Ft9g3oar29VRIq504CzScYtCu4rVhW4wfr7Q May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Id: 9b22744f23304e41b1c3a5d2bc0afdb9 May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-622862582 May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Role: reader,member May 26 13:41:14.253240 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Roles: reader,member May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9b22744f23304e41b1c3a5d2bc0afdb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b22744f23304e41b1c3a5d2bc0afdb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b22744f23304e41b1c3a5d2bc0afdb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9b22744f23304e41b1c3a5d2bc0afdb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotTestJSON-622862582 May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 9b22744f23304e41b1c3a5d2bc0afdb9 May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-622862582 May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotTestJSON-622862582-project May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Id: d9fc5cfd0a50441c9fd9116a7b5c514a May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotTestJSON-622862582-project May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: method: > May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: exception: Instance 9905f0da-0fe9-415a-8256-95cda343c11c could not be found. May 26 13:41:14.254632 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: action_args: {'id': '9905f0da-0fe9-415a-8256-95cda343c11c'} May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9905f0da-0fe9-415a-8256-95cda343c11c could not be found. May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:41:14.255538 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9905f0da-0fe9-415a-8256-95cda343c11c could not be found. May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9905f0da-0fe9-415a-8256-95cda343c11c could not be found. May 26 13:41:14.256805 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 26 13:41:14.257915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] Returning 404 to user: Instance 9905f0da-0fe9-415a-8256-95cda343c11c could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:41:14.257915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e697d08-8f6d-4228-aa42-09927cfd7805 tempest-VolumesSnapshotTestJSON-622862582 tempest-VolumesSnapshotTestJSON-622862582-project] 10.222.0.60 "GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c" status: 404 len: 111 microversion: 2.1 time: 0.031317 May 26 13:41:14.257915 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1115/2203] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 26 13:41:14 2022] GET /compute/v2.1/servers/9905f0da-0fe9-415a-8256-95cda343c11c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:41:53.427707 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:41:53.428401 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:41:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:42:45.015953 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:42:45.016549 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:42:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:44:25.872803 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:44:25.873437 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:45:13.435928 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:45:13.437282 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:45:58.070461 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:45:58.071114 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:45:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:46:05.024804 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:46:05.026250 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:46:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:46:23.492197 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:46:23.492800 dv-cinder-815146-11-iscsi devstack@n-api.service[124831]: Thu May 26 13:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:46:33.326881 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:46:33.327315 dv-cinder-815146-11-iscsi devstack@n-api.service[124830]: Thu May 26 13:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!